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ABSTRACT 

Pathbreaking  logistics  research  over  ihe  next  10  years  will  focus  on  systems 


problems.  Whereas  past  research  generally  has  taken  a  "bottom-up"  approach, 
future  investigations  are  likely  to  pursue  a  “top-down”  philosophy.  Specifically, 
attention  will  concentrate  on  diagnosis  of  systems'  improvement  potentials; 
easy-to-use  analytic  approaches,  inherently  approximative,  will  be  devised  for 
quickly  ascertaining  whether  a  complex  operating  system  can  be  substantially 
and  effectively  improved.  Theories  to  assist  in  overall  systems  design,  particu¬ 
larly  the  setting  of  boundaries  and  buffers  among  systems  components,  will  be 
developed.  At  the  same  time,  techniques  for  accurately  forecasting  future  sys¬ 
tems  performance  will  be  investigated. 

Underlying  such  research  will  be  efforts  to  gain  better  understanding  of 
management  information  requirements,  including  approaches  for  monitoring 
systems  performance  and  providing  early  warning  detection  of  systems  degrada¬ 
tion.  Improved  management  information  systems  will  have  to  be  coupled  with 
appropriate  design  of  managerial  organizations  and  assignment  of  decision  mak¬ 
ing  responsibilities.  Important  avenues  of  research  will  be  development  of 
robust  approaches,  that  is,  both  mathematical  techniques  and  organizational  ap¬ 
proaches  that  are  not  too  adversely  affected  by  limited  data,  a  changing  en¬ 
vironment,  and  human  frailty. 

Finally,  critical  research  will  be  directed  at  the  implementation  process, 
especially  the  interaction  among  initiation,  design,  testing,  and  ultimate  adop¬ 
tion. 

This  prognosis  will  explore  the  above  themes  in  the  context  of  large-scale, 
complex  systems.  The  decision  areas  will  encompass  inventory  replenishment, 
multiechelon  hierarchies  for  stockage  and  maintenance,  procurement,  transpor¬ 
tation,  scheduling,  facilities  planning,  budgeting,  reliability,  and  personnel 
management. 


THE  MOMENTUM  OF  HISTORY 
Functional  Subdivisions 


The  logistics  functions  in  commercial  and  military  organizations  are  so  well  established 
that  their  mission  and  performance  often  are  taken  for  granted.  Even  when  an  organization 
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undergoes  major  structural  renovation,  the  logistics  functions  may  escape  critical  notice.  Such 
activities  traditionally  are  defined  to  include  procurement  (including  purchasing  of  raw  materi¬ 
als,  packaging,  product  components,  subassemblies,  maintenance  items,  and  capital  equipment); 
manufacturing  administrative  processes  (including  scheduling  of  machinery,  sequencing  of  work 
orders,  selecting  of  manufacturing  techniques);  inventory  control  (including  stocking  of  raw 
materials,  in-process  working  inventory,  and  finished  goods);  distribution  of  resources,  that  are 
held  at  various  storage  locations;  and  transportation  (including  selection  of  carriers,  scheduling 
and  loading  of  transportation  equipment,  negotiation  of  rates,  and  movement  and  deployment 
of  personnel).  In  some  organizations,  logistics  also  encompasses  maintenance  and  repair  of 
equipment,  reliability  engineering,  and  facilities  planning. 

Despite  the  obvious  connections  among  these  functions,  many  organizations  separate  the 
responsibilities  for  the  various  logistics  activities.  As  a  result,  the  full  economic  and  service 
improvement  potential  that  could  be  realized  by  a  coordinated  effort  is  rarely  achieved.  Furth¬ 
ermore,  logistics  managers  frequently  are  postured  to  have  a  reactive,  rather  than  initiating, 
role.  More  specifically,  logistics  management  is  expected  to  execute  requests  from  other  parts 
of  the  enterprise,  but  not  to  actively  suggest  how  overall  integrative  systems  improvements  can 
be  made. 

Today  the  costs  of  logistics  have  become  sizeable,  however,  and  subject  to  tighter 
managerial  control,  so  that  large  organizations  can  no  longer  give  short  shrift  to  the  logistics 
functions.  To  the  contrary,  many  establishments  have  already  made  noteworthy  improvements 
by  eliminating  trouble  spots  in  their  logistics  functions.  As  we  shall  suggest,  significant  new 
opportunities  can  be  created  by  an  organization  that  recognizes  and  can  thus  coordinate  the 
linkages  among  its  various  separate  logistics  functions. 


Management  Science  Impact 

Early  in  the  evolution  of  management  science  and  operations  research,  scientists  realized 
that  central  logistics  issues  could  be  studied  and  eventually  comprehended  by  means  of  the 
developing  methods  of  applied  mathematics.  In  particular,  the  researchers  devoted  a  staggering 
amount  of  effort  to  formulating  scientific  models  of  inventory  control;  devising  scheduling  poli¬ 
cies  for  equipment,  projects,  and  production;  using  mathematical  programming  in  planning  ana¬ 
lyses;  testing  operating  doctrines  for  machine  maintenance,  repair,  and  replacement;  evaluating 
options  for  transportation  routing;  and  relieving  congestion  in  queuing  systems,  to  cite  only  a 
few  of  the  classic  problem  areas. 

The  challenge  of  these  problems  has  engaged  the  interest  of  talented  scientists,  including 
several  recent  Nobel  Prize  recipients.  In  addition  to  the  intrinsic  fascination  of  the  problems' 
natural  complexities,  the  research  was  impelled  by  the  growing  availability  of  large-scale  elec¬ 
tronic  computers  that  presumably  could  perform  numerous  calculations  and  could  store  and 
process  the  data  required  to  drive  the  model  analyses  to  usable  conclusions. 

Without  doubt,  the  degree  of  increased  understanding  afforded  by  the  model  building  of 
management  science  and  operations  research  in  the  past  30  years  is  impressive.  An  incredible 
amount  of  research  has  been  done  in  fathoming  the  nature  of  logistics  processes  and  their 
associated  decisions,  and  there  is  no  indication  that  interest  and  effort  are  waning. 

Nevertheless,  logistics  managers  are  justified  in  questioning  the  extent  to  which  the 
research  findings  have  affected  day-to-day  decision  making.  Without  denying  that  model- 
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building  research  has  brought  significant  systems  improvements,  such  managers  may  express 
the  wish  that  they  could  better  use  logistics  models  to  help  solve  the  remaining  larger  issues  of 
the  design  and  operation  of  entire  logistics  systems. 


The  Inward  Spiral 

As  in  all  branches  of  applied  science,  an  analytic  problem,  once  defined,  takes  on  a  life  of 
its  own,  regardless  of  its  original  source  and  setting.  These  problem  situations  seem  to  hold 
endless  fascination  for  succeeding  generations  of  scientists.  The  result  frequently  is  a  steady 
stream  of  refinements  and  extensions  of  the  original  formulation  and  analysis.  These  additions 
to  knowledge  may  not  be  trivial  from  a  technical  point  of  view;  their  elegance  and  generality 
may  warrant  the  intense  intellectual  effort  spent  producing  them.  Whether  such  progress  helps 
solve  the  original  real-life  problem  is  another  matter,  however.  The  nature  of  modei-building 
analysis  is  to  abstract  a  piece  of  a  complex  problem  that  can  be  subjected  to  fruitful  study. 
Unfortunately  but  inevitably,  the  resulting  approximation  to  reality  some  times  misses  the  tar¬ 
get  of  providing  a  useful  guide  to  decisionmaking.  Ample  evidence  demonstrates  that  subse¬ 
quent  research  often  pushes  the  formative  analysis  further  from  reality— that  is,  makes  progress 
in  areas  not  pertinent  to  the  critical  limitations  of  the  initial  approximation. 

Thus,  despite  the  current  active  research  in  logistics  processes,  we  cannot  ensure  that 
significant  research  breakthroughs  will  continue  if  we  rely  solely  on  letting  past  momentum 
determine  the  types  of  problems  and  the  technical  approaches  of  the  future.  To  offset  the 
natural  tendency  of  applied  research  to  spiral  inward,  logistics  managers  must  energetically 
make  known  the  problem  areas  that  cry  out  for  new  analysis.  Constant  infusion  of  reality  in 
logistics  research  is  the  best  guarantee  that  the  next  decade  of  effort  will  have  a  major  impact. 


A  SCORECARD  OF  RESEARCH  PROGRESS 
Bottom-up  and  Top-down  Orientation 


By  and  large,  logistics  models  have  focused  on  phenomena  at  the  bottom  levels  of  organi¬ 
zations.  For  example,  the  mathematical  models  derived  over  the  past  three  decades  have  dealt 
with  replenishment  of  individual  stock  items,  initial  provisioning  of  spare  parts,  sequencing  of 
particular  orders,  overhaul  of  particular  pieces  of  equipment,  replacement  of  particular  com¬ 
ponents,  and  so  forth.  A  corollary  is  that  these  models  have  concentrated  on  single  types  of 
logistics  decisions  (replenishment,  procurement,  maintenance,  transportation)  rather  than  on 
systems  of  decisions.  Even  the  notable  exceptions  to  this  generalization,  such  as  in  applications 
of  mathematical  programming  models  that  deal  with  the  deployment  of  limited  resources,  often 
treat  as  given  certain  assumptions  that  the  highest  level  of  management  would  prefer  to  con¬ 
sider  as  variables.  To  illustrate,  in  a  transportation  distribution  study  using  mathematical  pro¬ 
gramming,  the  analysis  typically  takes  as  given  the  products  to  be  shipped  and  the  customers  to 
be  served.  Top  management  may  be  more  interested  in  whether  the  products  should  be 
manufactured  at  all,  whether  certain  customers  are  unprofitable  because  of  the  transportation 
rate  structure,  and  how  much  service  is  required  by  customers.  Of  course,  such  issues  can  be 
sorted  out  in  part  with  the  aid  of  models,  but  in  practice  the  typical  study  orientation  has  been 
to  ignore  such  issues. 
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Another  way  of  stating  the  point  is  to  say  that  most  management  science  and  operations 
research  models  dealing  with  logistics  have  not  begun  by  attacking  the  questions  that  would  be 
posed  by  the  topmost  level  of  management.  For  example,  when  senior  management  is  asked  to 
approve  a  systems  design  effort  to  tighten  inventory  control,  it  wants  an  estimate  of  the  savings 
potential  of  such  a  new  design.  When  expansion  of  a  factory  warehouse  is  proposed,  senior 
management  wants  an  assessment  of  the  possible  share-of-market  impact  of  having  more  or 
less  stock  at  the  location,  which  may  be  geographically  removed  from  the  company's  customers. 
When  a  new  product  is  to  be  introduced  by  a  computer  manufacturer,  top  management  wants 
to  know  the  economic  ramifications  of  providing  for  concomitant  repair  and  service,  including 
the  cost  of  parts  replenishment.  In  brief,  senior  managements  typically  seek  a  comprehensive 
economic  analysis  of  the  "big  picture.” 

Management  scientists  have  assumed,  almost  as  an  axiom,  that  to  obtain  answers  to 
high-level  management  questions,  one  must  build  the  analysis  from  the  bottom  up  Thus,  to 
predict  an  inventory  system’s  performance,  the  researcher  has  been  inclined  to  add  up  the  per¬ 
formance  characteristics  of  the  individual  components.  Regretably,  this  bottom-up  presumption 
has  not  proven  itself  to  be  without  severe  limitations.  One  difficulty  has  been  the  sheer  effort 
involved  in  ascertaining  and  then  "adding  up"  the  component  details.  The  analytic  and  data- 
processing  difficulties  that  arise  from  starting  at  the  bottom  and  aggregating  up  can  be  severe 
and  can  consume  much  of  the  analytic  staff s  time  and  energy.  Ironically,  in  such  instances 
senior  management  finds  itself  funding  its  own  research  project  to  learn  whether  the  organiza¬ 
tion  can  benefit  from  previous  logistics  research. 

To  make  matters  worse,  the  "adding  up"  process  may  amplify  rather  than  dampen  the 
errors  in  the  approximative  assumptions  of  micromodels.  When  economies  or  diseconomies  of 
scale,  such  as  occur  in  the  loading  and  routing  of  transport  vehicles,  are  present,  but  virtually 
ignored  by  a  microcosmic  model,  the  consequent  aggregation  of  individual  calculations  can  be 
far  off  the  mark.  What  appears  to  be  an  incidental  approximation  in  the  small  can  turn  out  to 
be  a  gross  and  misleading  oversimplification  in  the  large. 

It  is  becoming  clearer  that  these  top  management  issues  ought  to  be  modeled  in  their  own 
right.  The  potential  advantages  include  faster  and  more  accurate  results.  Even  more  impor¬ 
tant,  perhaps,  starting  at  the  top  affords  a  better  opportunity  to  focus  on  issues,  assumptions, 
and  evaluation  criteria  that  are  most  relevant  to  senior  management. 

So  that  there  is  no  misunderstanding,  we  hasten  to  acknowledge  that  top-down  analysis  is 
not  yet  easy.  In  fact,  we  believe  that  this  point  of  view  will  be  a  major  focus  of  research  over 
the  next  decade.  The  research  tasks  certainly  will  be  at  least  as  difficult  and  challenging  as 
those  that  have  been  confronted  with  the  bottom-up  approach.  Work  to  date  suggests  that  con¬ 
siderable  innovation  will  be  required. 

The  Narrow  ’ind  of  the  Time  Tunnel 


Logistics  models  have  addressed  management  decisions  that  at  one  extreme  pertain  to 
daily  phenomena,  such  as  replenishment,  scheduling,  and  repair,  and  at  the  other  extreme,  to 
long-range  commitments,  such  as  plant  location,  capacity  expansion,  and  development  of  new 
products.  A  common  observation  is  that  at  the  first  extreme  the  mathematical  models  are 
simpler  to  analyze  (in  the  sense  that  they  require  less  data  and  computation)  but  harder  to 
implement  (in  the  sense  that  they  frequently  require  a  sweeping  systems  design).  In  contrast, 
planning  models  for  long-term  decisions  provide  extremely  useful  information  with  a  reason¬ 
able  amount  of  effort,  but  involve  an  inordinately  heavy  use  of  computers  and  data  manipula¬ 


tion. 
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Most  logistics  management  functions  in  large  enterprises  involve  an  amalgam  of  both 
short-  and  long-term  decisions.  An  important  implication  is  that  management  of  these  enter¬ 
prises  must  be  prepared  to  deal  with  the  different  organizational  stresses  that  arise  from  apply¬ 
ing  management  science  and  operations  research  efforts  at  the  two  ends  of  the  tim '-horizon 
spectrum.  Research  staff  thus  must  include  personnel  capable  of  one-time  innovative  model 
building  and  data  analysis  as  well  as  of  designing  and  implementing  operating  systems. 

Leashing  the  Crunchers 

A  curious  paradox  is  connected  with  the  use  of  large  computers.  As  pointed  out  previ¬ 
ously,  advances  in  computer  software  and  hardware  technologies  have  spurred  the  development 
of  logistics  model  building.  It  is  inconceivable  that  the  progress  made  so  far  in  studying  logis¬ 
tics  decisions  could  have  taken  place  if  computer  developments  had  leveled  off.  Furthermore, 
to  the  extent  that  such  models  have  been  applied  to  strategic  as  well  as  to  operational  decision¬ 
making  situations,  computers  have  been  essential.  Nevertheless,  the  difficulties  in  using  com¬ 
puters  in  new  model-building  situations  still  are  severe.  In  fact,  even  in  so-called  standard 
applications,  such  as  the  development  of  a  new  medium  or  large-scale  linear-programming 
model,  the  tasks  of  collecting  and  analyzing  the  data,  converting  the  data  into  model 
coefficients,  obtaining  usable  optimization  results,  and  providing  management  with  readable 
analyses  are  now  by  no  means  routine.  Admittedly,  experienced  technical  experts  now  have  a 
much  better  time  of  it  than  do  novices.  Also,  today  an  organization  receives  considerably  more 
"computation  per  buck"  than  it  did  a  decade  ago.  Be  that  as  it  may,  management  must  not  view 
as  insignificant  the  development  and  completion  effort  for  a  logistics  model  application.  To  add 
to  the  paradox,  those  software  developments  aimed  at  enhancing  the  application  of  a  particular 
class  of  models,  such  as  mathematical  programming,  have  turned  out  to  increase  the  learning 
setup  time  of  beginners. 

A  related  point  is  that,  all  of  the  statisticians’  research  not  withstanding,  model-building 
practitioners  often  are  forced  to  resort  to  crude  ad  hoc  data  manipulation  procedures  in  order  to 
analyze  historical  information.  Unfortunately,  a  model  builder  who  has  had  a  standard  intro¬ 
duction  to  regression  analysis,  for  example,  is  not  very  well  equipped  to  detect,  let  alone 
design,  useful  data  fitting  formulas.  Part  of  the  difficulty,  of  course,  is  inadequate  education. 
However,  to  offer  a  comparison,  a  logistics  model  builder  need  not  be  a  highly  trained  technical 
expert  or  mathematician  to  run  a  standard  linear-programming  computer  routine.  Yet  the  same 
individual  is  almost  certain  to  fail  in  manipulating  a  set  of  data  on  a  dependent  and  several 
independent  variables  in  trying  to  obtain  a  tight  regression  fit.  (The  usual  approach  is  to 
employ  standard  multiple  linear  regression  and  hope  that  the  resulting  fit  will  be  fairly  good.) 
Oddly,  most  high-powered  statistical  routines  now  available  on  computers  provide  copious  sta¬ 
tistical  tests  that  seem  to  make  little  sense  to  most  users.  Hence,  data  analysis  for  managerial 
decisionmaking  is  a  burgeoning  field  with  vast  opportunities. 

Management  scientists  and  operations  researchers  are  only  beginning  to  come  to  grips 
with  the  intricate  data  analysis  problems  that  arise  in  the  use  of  computer  simulations  of  sto¬ 
chastically  driven  systems.  Of  course,  the  complexity  of  such  problems  has  been  recognized  for 
many  years,  but  only  recently  has  there  been  a  better  appreciation  of  how  pervasive  and  knotty 
these  difficulties  are.  The  unsophisticated  simulation  model  builder  traditionally  has  assumed 
that  all  such  estimation  problems  could  be  "bought  off"  by  investing  in  a  sufficiently  long  simu¬ 
lation  history.  In  a  trivial  sense,  that  attitude  is  correct  — but  only  lately  has  it  become  apparent 
that  a  sufficiently  long  history  may  be  far  longer  than  most  practitioners  would  ever  have 
guessed.  Computation  time  is  a  scarce  and  costly  resource,  and  the  solution  to  these  problems 
is  not  to  run  longer  but  to  run  smarter.  At  last  this  topic  is  under  active  research  investigation. 
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Crossing  the  Technical  Barriers 

In  the  next  section  of  this  paper,  we  suggest  several  general  classes  of  problems  that  will 
challenge  future  researchers  of  logistics  decisions.  Here  we  note  a  few  of  the  technical  prob¬ 
lems  that  remain  and  attract  the  attention  of  researchers. 

In  one  way  or  another,  all  realistic  applications  of  model  building  to  logistics  decisions 
involve  dealing  with  large-scale  systems.  The  source  of  bigness  may  be  the  great  detail  that 
must  be  encompassed,  for  example,  as  in  implementation  of  stockage  rules  for  a  system  of  tens 
of  thousands  of  inventoried  items,  or  the  source  may  be  the  large  number  of  options  to  be 
addressed,  as  in  a  multiperiod  strategic  planning  model. 

The  problems  of  large-scale  applications  include  both  the  sheer  number  of  computations 
required  as  well  as  the  vast  amounts  of  input  data  that  must  be  collected  and  reviewed  and  the 
resulting  extensive  output  to  be  analyzed.  Much  progress  is  needed  in  techniques  that  help 
human  analysts  comprehend  large  sets  of  data.  (Recent  developments  in  computer  graphics  are 
good  examples  of  what  can  be  done  to  let  a  human  literally  see  multidimensional  phenomena.) 

A  related  problem  is  the  development  of  methods  for  testing  model  assumptions  and  data 
error  sensitivity.  Although  many  mathematical  formulas  have  been  developed  to  answer 
specific  sensitivity  questions  about  particular  model  structures  (such  as  those  that  arise  in 
analysis  of  linear-programming  models),  there  is  still  no  unifying  approach  or  point  of  view  for 
ferreting  out  which  of  the  many  parameters  are  most  critical.  A  higher  level  of  computer- 
assisted  thinking  is  needed  to  alert  the  model  builder  to  the  weak  points  of  the  model. 

Discontinuities,  nonconvexities,  and  combinatorial  phenomena  are  not  yet  completely 
under  the  thumbs  of  operations  research  analysts.  Although  significant  progress  has  been  made 
with  such  problems  in  the  past  5  years,  the  halfway  mark  probably  has  not  been  reached. 

Interestingly,  the  applied  science  community  is  not  complaining  that  the  mathematical 
problems  are  too  complex  to  allow  continued  research  progress.  Progress  seems  slow,  and  the 
power  required  certainly  is  escalating,  but  there  does  not  appear  to  be  any  din  of  discussion 
among  management  scientists  and  operations  researchers  centering  on  the  few  major  unsolved 
technical  problems  that  persist  in  defying  successful  attack.  Rather,  the  lament  is  that  problems 
currently  under  study  are  old-hat  and  of  less  intrinsic  interest  than  those  addressed  in  the  early 
days  of  logistics  research. 

Without  judging  the  validity  or  propriety  of  this  lament,  we  argue  in  the  next  section  that 
many  important  research  tasks  remain  to  be  faced  in  the  coming  decade.  As  will  be  apparent 
from  the  discussion,  the  starting  point  for  many  of  these  topics  is  not  the  previously  made  gen¬ 
eralization  on  the  classic  types  of  logistics  models.  Rather,  the  recommended  approach  is 
redefinition  of  the  remaining  problems,  taking  into  explicit  account  the  pressing  needs  of  logis¬ 
tics  managers.  We  propose  a  renewed  and  vigorous  look  at  managers’  topical  problems  rather 
than  previous  researchers’  leftover  problems. 

THE  CHALLENGES  THAT  AWAIT 

A  View  to  the  Practical 

In  analytic  research  into  logistics  decisions,  management  scientists  and  operations 
researchers  have  been  inclined  to  let  the  mathematical  formulation  of  a  model  dictate  or  sug¬ 
gest  the  appropriate  mode  of  analysis.  For  example,  when  decision  problems  have  been  posed 
in  terms  of  dynamic-programming  functional  equations,  then,  generally,  researchers  have 
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explored  mathematical  and  computational  ways  to  solve  the  functional  equations.  In 
inventory-control  models,  research  has  focused  on  ascertaining  the  form  of  an  optimal  policy 
and  determining  the  computational  implications  of  exploiting  this  knowledge  of  the  optimal 
form.  Similar  illustrations  could  be  cited  for  other  types  of  probabilistic  applications.  Unfor¬ 
tunately,  even  after  an  initial  mathematical  formulation  has  been  simplified  by  taking  account 
of  analytically  derived  information  about  the  form  of  the  model’s  solution,  the  complexity  and 
the  computational  burden  remaining  is  not  trivial.  As  a  result,  applications  of  many  such 
models  have  been  limited,  and  sometimes  even  nonexistent. 

An  alternate  approach,  which  is  beginning  to  have  some  currency,  is  to  derive  simple  but 
close  analytic  approximations  to  the  original  model.  These  approximations  are  easier  to  handle 
computationally  and  are  therefore  much  more  attractive  from  an  applications  point  of  view. 
(An  example  will  be  provided  in  the  next  section.)  In  most  real-life  situations  the  data 
required  by  a  model  are  themselves  approximate,  by  the  very  nature  of  their  historical  base. 
Hence,  the  degradation  of  economic  performance  due  to  analytic  approximation  may  be  negligi¬ 
ble.  Imperfect  information  typically  overshadows  the  analytic  approximation  as  a  source  of 
model  error.  Although  numerical  approximation  is  a  seasoned  topic  in  computer  science  and, 
to  an  extent,  in  statistics  (by  way  of  curve  fitting),  the  subject  is  relatively  new  in  operations 
research.  It  offers  considerable  promise  and  may  make  practical  the  solution  of  many  models 
that  have  been  discarded  earlier  as  computationally  unwieldy. 

A  related  technique  is  to  derive  analytic  models  with  parameter  values  that  are  numeri¬ 
cally  fit  from  a  limited  discrete  set  of  optimal  points  (policies).  These  fitted  relations  permit 
interpolation  of  intermediate  parameter  settings.  In  other  words,  the  researcher  starts  with  a 
grid  of  parameter  values,  performs  the  detailed  model  optimizations  to  derive  the  best  policies 
for  the  grid,  and  then  fits  an  analytic  function  of  the  parameter  values  to  the  set  of  numerical 
policies. 

A  similar  vein  of  research  is  to  discover  the  actual  sensitivity  of  optimal  policies  to  vari¬ 
ous  parameters  of  a  model.  Evidence  is  building  that  many  models  that  appear  to  involve  mul¬ 
tivariate  optimization  can  without  much  loss  be  factored  into  separate  optimizations,  each 
requiring  an  easier  manipulation  of  fewer  variables. 

In  summary,  considerable  future  research  will  be  turned  to  investigating  the  numerical 
properties  of  logistics  models,  with  emphasis  on  parameter  settings  that  are  relevant  for  actual 
applications.  Such  investigations  will  result  in  computational  models  that  are  simpler  to  use  and 
thus  will  enhance  the  applicability  of  the  models. 

Breakdown  of  the  Boundaries 

Perhaps  the  most  important  of  all  the  new  avenues  for  future  research  will  be  modeling 
efforts  that  combine  heretofore  separate  investigations  of  logistics  decisions.  Examples  abound 
in  military  logistics  systems.  There  are,  for  example,  significant  economic  tradeoffs  relating  to 
initial  procurement,  spares  provisioning,  location  of  repair  facilities,  design  of  component  parts, 
and  installation  of  data  collection  systems  to  track  weapon-system  performance.  Similar  illustra¬ 
tions  are  easily  cited  in  commercial  organizations.  For  example,  a  manufacturing  company 
must  balance  off  considerations  of  labor  stability,  the  buildup  of  seasonal  inventories,  the  loca¬ 
tion  of  such  inventories,  the  mode  of  transportation  to  customers,  the  frequency  of  delivery  in 
relation  to  the  capacities  of  transport  vehicles,  and  the  targeted  service  performance  (that  is, 
availability  of  stocks  and  promptness  of  delivery). 
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A  bottom-up  approach  for  investigating  the  interactions  among  logistics  functions  does 
not  seem  as  promising  or  as  practical  as  a  top-down  approach.  In  constructing  a  top-down 
model,  however,  a  researcher  should  keep  in  mind  the  operating  characteristics  of  low-level 
logistics  models  and  include  these  characteristics  in  the  formulation  of  the  high-level  model. 
For  example,  if  a  segment  of  an  inventory  system  has  a  square-root  relational  dependency  on 
the  annual  demand  for  the  encompassed  items,  then  that  system's  numerical  phenomena 
should  be  included  in  the  model  specification. 

Because  of  the  inherent  complexity  of  multifunction  models,  a  successful  analytic 
approach  may  involve  exploring  only  a  set  of  case  studies  rather  than  seeking  some  sort  of  glo¬ 
bal,  or  even  local,  optimum.  In  other  words,  the  model  builder  may  have  better  success  in 
investigating  plausible  solutions  and,  with  feedback,  refined  versions  of  the  alternatives,  than  in 
trying  to  simplify  the  interconnections  in  the  mathematical  structure  to  permit  "automatic" 
optimization  algorithms.  The  case-study  approach  to  integrative  analyses  also  facilitates  the 
inclusion  of  discontinuous  economic  and  physical  phenomena.  After  the  number  of  high-level 
decision  options  has  been  narrowed  to  a  select  and  attractive  few,  then  the  now-familiar  lower 
level  model-building  approaches  can  be  brought  into  play  to  refine  the  analyses  if  need  be. 

The  Human  Side  of  Systems  Design 

It  is  surprising,  perhaps  shocking,  that  virtually  no  research  attention  has  been  given  to 
the  human  factors  aspect  of  modern  logistics  systems  design.  If  logistics  research  is  to  become 
part  of  the  warp  and  woof  of  an  organization,  attention  must  be  given  to  the  organizational  set¬ 
ting,  including  the  assignment  of  responsibilities.  For  example,  even  if  model  builders  succeed 
in  breaking  down  the  boundaries  between  logistics  functions,  little  benefit  will  result  if  there  is 
no  corresponding  integration  of  management  logistics  responsibilities.  In  a  manufacturing  com¬ 
pany,  the  links  between  sales  forecasting,  production  planning,  and  materials  purchasing  are 
critical  to  the  economic  functioning  of  each  of  these  activities.  A  comprehensive  logistics 
model  would  combine  the  three  elements,  but  the  model  would  not  produce  results  unless  the 
three  functions  were  controlled  by  a  consistent  corporate-wide  logistics  management  policy. 

The  organization  of  most  logistics  operations  in  an  enterprise  is  based  on  historical  evolu¬ 
tion;  changes  have  taken  place,  if  at  all,  typically  at  times  of  crisis.  Yet  almost  always  large 
improvements  can  be  made  as  a  result  of  a  comprehensive  look  at  the  logistics  needs  of  the 
organization.  More  often  than  not,  much  of  the  improvement  devolves  from  realignment  of 
responsibilities  along  with  appropriate  management  review  and  control,  rather  than  from  revi¬ 
sion  of  isolated  decisionmaking  processes,  such  as  production  scheduling.  In  other  words,  most 
separate  logistics  functions  fare  pretty  well  given  the  organizational  constraints  under  which 
they  operate;  any  noteworthy  improvement  comes  from  breaking  down  some  of  the  constraints. 

Considerable  future  research  effort  is  required  not  only  in  thinking  through  organizational 
structure,  but  in  examining  effective  approaches  to  personnel  motivation,  the  communication  of 
information  for  decisionmaking,  and  management  review  and  control,  insofar  as  these  human 
activities  bear  on  the  design  of  integrative  logistics  systems.  Logistics  personnel  in  most  enter¬ 
prises  are  prone  to  a  "beat-the-system"  attitude;  this  proclivity  should  be  recognized  explicitly 
and  factored  into  the  systems  design  process. 

Finally,  even  assuming  :nign  attitudes  within  an  organization,  researchers  must  explore 
ways  to  improve  the  interactu  is  between  personnel  (managerial,  staff,  and  clerical)  on  the  one 
hand  and  computer-driven  data  systems  on  the  other.  The  notion  that  a  computerized  logistics 
system  is  conducive  to  easier  decisionmaking  is  too  naive  to  be  of  value.  In  fact,  a  computer¬ 
ized  approach  often  seems  to  make  some  jobs  harder  and  others  duller.  Rarely  does  the  imple¬ 
mentation  of  such  a  system  result  in  an  upgrading  and  simplification  of  jobs  throughout.  The 
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commonly  expressed  negative  attitudes  about  computet  systems  in  large  organizations  are 
grounded  in  considerable  experience,  and  the  root  causes  call  for  careful  study. 

A  Window  on  the  Future 

Now  that  30  years  of  logistics  research  have  passed,  senior-level  management  has  come  to 
feel  that  it  should  be  possible  to  diagnose  the  need  for  systems  improvement  without  undertak¬ 
ing  a  major,  lengthy  research  project.  It  is  incredible  to  such  managers  that  systems  analysts  are 
unable  after  a  brief  investigation  to  at  least  scope  out  a  reasonable  range  of  improvement  poten¬ 
tial  from  contemplated  systems  revisions.  But  strange  as  it  may  be,  management  scientists  and 
operations  researchers  have  made  little  progress  in  devising  powerful  diagnostic  tools.  That 
should  be  given  priority.  The  effort  will  have  to  be  empirically  based  in  part,  at  least  insofar  as 
the  suggested  approaches  should  stand  the  test  of  actual  field  validation.  The  purpose  of  these 
diagnostic  tools  is  to  provide  management  with  estimates  of  the  future  benefits  of  a  commit¬ 
ment  to  invest  in  systems  revision.  A  top-down  orientation  would  seem  to  provide  the  proper 
perspective. 

A  similar,  possibly  more  technical  topic  is  study  of  methods  for  predicting  systems  perfor¬ 
mance  when  new  decision  rules  are  to  be  used.  In  this  context,  suppose  that  a  proposed  design 
has  been  worked  out  in  detail,  but  that  some  of  the  parameter  settings  used  in  the  design 
remain  under  investigation.  As  an  example,  perhaps  the  frequency  of  data  revision  and  file 
update  is  in  question.  Systems  performance  characteristics  often  are  investigated  by  means  of  a 
simulation.  Such  simulations  usually  are  computer  models  themselves,  but  sometimes,  espe¬ 
cially  in  military  systems,  they  are  onsite  tests.  Little  scientific  research  has  been  done  to  estab¬ 
lish  the  validity  of  these  predictive  approaches.  Practical  considerations  frequently  rule  out  rou¬ 
tine  application  of  classical  statistical  design-of-experiments  methods.  In  the  methods  com¬ 
monly  used  in  practice,  often  a  bias  exists  that  makes  a  proposed  system  design  appear  to  per¬ 
form  better  than  it  will  in  fact.  The  source  of  the  bias  is  easy  to  detect,  once  one  is  alert  to  its 
possible  existence,  but  correcting  it  may  be  difficult.  In  admittedly  over-simplified  terms,  the 
bias  arises  because  the  new  det  gn  itself  has  been  fashioned  according  to  historical  data,  and 
therefore  it  appears  to  perform  well  in  historical  perspective.  The  inescapable  difficulty  is  that 
of  necessity  many  models  are  driven  by  historical  information  that  may  be  so  limited  as  to 
prohibit  using  a  "split-sample"  approach  to  validation. 

A  related  need  is  for  monitoring  devices  and  early  warning  controls  that  automatically 
determine  when  a  new  systems  design  revision  may  be  warranted.  Presumably,  if  progress  is 
made  in  fashioning  diagnostic  and  predictive  tools,  the  way  will  be  paved  for  the  devising  of 
continuing  controls  that  automatically  determine  when  a  new  systems  design  revision  may  be 
warranted.  Here  too,  a  top-down  approach  seems  appropriate.  It  may  be  very  difficult  to  detect 
any  systems’  performance  degradation  by  looking  at  individual  components  one  by  one.  Sensi¬ 
tive  aggregates,  if  such  can  be  found,  are  needed. 

Disaster  Insurance 

Mathematical  programmers  have  learned  an  important  lesson  that  should  be  noted  by  all 
model  builders.  A  single-criterion  optimization  model  typically  pushes  to  the  greatest  extent 
possible  each  simplifying  assumption  in  a  model.  For  example,  if  a  nonlinearity  has  been 
approximated,  the  optimization  process  will  find  how  to  exploit  the  approximation.  As  a  result, 
the  solution  may  strain  the  assumptions  beyond  credibility  and  usability. 
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To  the  extent  that  logisitcs  research  model  building  will  break  down  the  barriers  between 
functions,  as  proposed  earlier,  care  will  have  to  be  taken  that  the  resulting  solutions  are  not 
"too  tightlj  tuned."  The  organization  must  be  able  easily  to  buffer  unexpected  (unmodelled) 
events.  It  is  likely  that  second-best  (less-than-first-best)  strategies  may  be  preferred  if  they  do 
not  force  the  organization  into  assuming  a  confining  posture.  Observers  of  real  organizations 
recognize  that  most  managements,  usually  with  good  reasons,  shy  away  from  strategies  that 
have  serious  downside  risks.  Aside  from  recognizing  the  existence  of  multicriteria  problems, 
management  scientists  and  operations  researchers  have  not  made  much  progress  in  discovering 
the  sensitivity  of  strategies  to  criteria  that  recognize  and  avoid  downside  risks. 

The  goal-establishment  problem  is  not  solely  technical;  it  also  concerns  the  organizational 
issues  mentioned  above.  The  enterprise  must  build  in  buffers,  by  a  careful  structuring  of  the 
organization,  to  absorb  unplanned-for  shocks.  To  illustrate,  the  production  management  com¬ 
ponent  of  a  system  may  need  to  have  a’  backlog  of  maintenance  projects  to  fill  up  slack  time 
that  may  arise  when  the  marketing  organization  has  been  over-optimistic  in  its  forecasts  of 
sales. 

To  the  extent  that  approximate  models  will  be  devised,  care  must  be  taken  that  the 
recommended  decisions  do  not  degrade  too  badly  when  the  model’s  assumptions  become 
invalid.  For  example,  even  though  there  may  be  very  little  lost  in  the  original  optimization 
model  when  a  parameter  is  misspecified,  the  same  need  not  be  true  in  the  approximative  ver- 
s.on  The  chief  source  of  misspecification  in  real  applications  is  the  uncertainty  about  future 
demand  failure  rates,  procurement  costs,  transport  reliability,  and  so  forth. 

Getting  the  Job  Done 

The  process  of  systems  implementation  deserves  attention  in  its  own  right.  It  has  become 
apparent  that  the  full  process  of  implementation  has  many  components,  some  of  which  concern 
the  nature  of  the  decision  problem,  some  the  organizational  setting,  and  some  the  support  sys¬ 
tems  design.  It  is  important  that  a  framework  of  analysis  be  established  to  piece  together  the 
essential  components,  namely  the  decisions  affected,  the  targeted  benefits,  the  downside  risks, 
the  assignment  of  responsibilities,  the  development  of  the  systems  approach,  the  education  of 
managers  and  support  staff,  the  inherent  life  cycle  of  the  application,  the  specific  systems 
design,  the  required  data,  and  the  model’s  validation. 

In  addition,  it  would  be  helpful  to  examine  managers'  psychology  with  regard  to  systems’ 
development  authorization— for  example,  how  do  they  view  associated  career  development 
hazards,  assess  the  reasonableness  of  a  project’s  timetable,  decide  whether  the  design  will  be 
useful  and  avoid  being  embarrassed  by  an  unsuccessful  outcome. 

I  « 

The  proper  methodology  for  studying  implementation  is  itself  a  research  issue.  The  term 
"implementation"  actually  presents  a  problem  of  definition  and,  in  any  event,  implies  a  value 
connotation  in  that  agreeing  to  implement  is  normally  presumed  to  be  good  and  failing  to 
implement  to  be  bad.  To  make  sense  out  of  implementation  processes,  researchers  must  estab¬ 
lish  standards  of  comparison  that  are  legitimate  within  a  single  organization  as  well  as  across 
organizations. 

Summary 

This  section  has  touched  on  a  number  of  avenues  of  research  in  logistics  systems  design 
that  could  have  significant  impact  if  successfully  pursued.  In  looking  back  over  the  list,  it  is 
clear  that  the  suggestions  are  not  aimed  at  particular  types  of  logistics  decisions.  They  are 
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aimed,  rather,  at  a  type  of  approach  that  cuts  across  individual  logistics  decision  areas.  Hope- 
fully,  the  list  makes  clear  those  challenges  that  stem  from  recognition  of  organizational  and 
managerial  needs  in  relation  to  unsolved  and  mind-boggling  technical  puzzles.  Assuredly,  the 
suggested  research  areas  are  replete  with  tough  analytic  tasks,  and  the  technical  inspiration 
required  will  not  derive  solely  or  even  mainly  from  the  methods  of  past  applied  logisitics 
research 

A  GLIMPSE  AT  THE  POSSIBLE 
Strategy  for  Research 

A  rich  variety  of  applied  mathematics  approaches  has  become  standard  in  management 
science  and  operations  research  studies  of  logistics  processes.  They  include  mathematical  pro¬ 
gramming  optimization,  dynamic  programming,  Markovian  analysis,  and  computer  simulation, 
to  name  only  the  more  prominent.  The  primary  role  of  computers  has  been  to  perform  algo¬ 
rithmic  computations  on  particularized  versions  of  mathematical  programming  models  and  to 
provide  simulated  results  for  (typically)  stochastic  systems  run  with  special  settings  of  the 
underlying  model’s  parameters. 

Intererstingly,  the  computer  has  seldom  been  used  to  ferret  out  the  qualitative  properties 
of  models,  to  provide  the  analog  of  the  physical  scientist’s  experimental  laboratory.  We  believe 
that  substantial  breakthroughs  are  possible  in  many  logistics  research  problems  that  are  now 
deemed  intractible  because  the  standard  applied  mathematical  approaches  have  been  pushed  to 
their  limit.  We  suggest  and  illustrate  in  this  section  how  computers  can  be  used  to  provide  new 
analytic  models  capable  of  solving  some  currently  unanswered  high-level  management  ques¬ 
tions. 

A  Case  in  Points 

Take  as  an  example  the  subject  of  inventory  control.  Over  the  past  two  decades, 
mathematical  analysis  of  inventory  stockage  models  has  made  great  progress,  and  real-life 
implementation  of  inventory  systems,  based  at  least  in  part  on  the  results  of  this  modern 
research,  has  taken  place.  Nevertheless,  when  an  organization  considers  the  possibility  of 
designing  and  installing  a  new  replenishment  system,  senior  management  typically  finds  it  ardu¬ 
ous  and  time-consuming  to  obtain  reliable  answers  to  questions  such  as 

•  What  are  the  effects  of  consolidating  demands  from  several  different  warehouses  into  a 
single  central  warehouse? 

•  If  system-wide  demand  increases  (through,  for  example,  an  enlarged  share  of  the 
market),  what  are  the  resulting  cost  and  service  implications? 

•  How  much  is  it  worth  to  obtain  quicker  delivery  of  replenishment  orders? 

•  By  how  much  will  costs  rise  if  service  is  increased? 

•  How  wilt  costs  be  affected  by  less  frequent  updating  of  information? 

for  some  of  these  questions,  no  easy-to-use  analytic  formulas  have  been  devised.  For  others, 
an  answer  is  forthcoming  only  if  the  analyst  painstakingly  uses  a  bottom-up  approach,  that  is, 
makes  the  calculations  for  each  of  a  number  of  individual  stockage  items  and  then  aggregates 
the  results. 
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Recently  an  alternative  analytic  approach  has  been  investigated  by  the  author  and  his  asso¬ 
ciates,  Richard  Ehrhardt,  Alastair  MacCormick,  Ronald  Kaufman,  Arthur  Estey,  and  John  Klin- 
cewicz.  A  capsule  view  is  provided  below  to  indicate  the  nature  of  the  research  strategy. 

Systems  Design  Scenario 

Consider  an  inventory  manager  who  must  design  a  system  of  replenishment  rules  for  the 
stockage  of  possibly  thousands  of  items.  Assume  that  the  manager  can  specify  a  criterion  func¬ 
tion  to  determine  whether  one  system  design  is  better  than  another.  Suppose  that  the  manager 
has  elected  to  use  so-called  (s,5)  policies:  when  inventory  on  hand  and  on  order  falls  below  s, 
place  an  order  so  that,  as  a  consequence,  inventory  on  hand  and  on  order  equals  S.  It  is  neces¬ 
sary  to  compute  numerical  values  for  the  pair  (s,S)  for  each  item  to  be  stocked.  Under  widely 
applicable  conditions,  it  is  possible  to  employ  an  algorithmic  approach  that  provides  optimal 
values  for  (s,S),  but  the  computations  are  numerous  and  make  application  to  a  large-scale  sys¬ 
tem  prohibitive.  Further,  the  optimizing  algorithm  assumes  that  the  demand  distribution  for 
each  item  is  known  exactly;  this  is  virtually  never  true  in  practice.  The  manager  inevitably 
must  use  past  data  to  estimate  the  demand  distribution. 

The  systems  designer’s  tasks  then  include  selecting  in  concert  the  number  of  historical 
observations  to  use,  the  frequency  for  repeating  the  reestimation  process,  the  form  of  me 
replenishment  rule,  the  statistical  estimators  to  produce  the  demand  parameters  required  by  the 
rule,  and  the  design  parameters  of  the  rule,  namely,  the  values  of  s  and  S  in  our  illustration. 
Typically  the  manager  makes  all  of  these  choices,  at  least  in  part,  according  to  simulations  of 
how  the  proposed  system  would  have  performed  in  the  past.  In  doing  so,  the  manager  typically 
uses  the  same  limited  data  for  both  estimating  the  demand  parameters  and  predicting  systems 
performance. 

Recognizing  and  Attacking  the  Issues 

Eventually,  inventory  managers  will  have  to  provide  the  answers  to  the  questions  posed 
by  senior  management.  But  even  before  attacking  top  management’s  questions,  the  designer 
must  find  a  practical  approach  to  the  mundane  issues  of  calculating  the  rule  values  themselves 
and  discovering  how  accurate  the  retrospective  predictions  are  likely  to  be.  Regretably,  these 
tasks  are  mathematically  so  complex  that  they  do  not  appear  tractible  by  known  methods  of 
applied  analysis. 

It  is  possible  to  make  considerable  headway,  however,  by  devising  an  experimental  design 
approach  with  the  further  help  of  a  computer,  first  postulating  a  set  of  parameter  values  that 
encompasses  most  of  the  cases  likely  to  be  encountered.  For  the  sake  of  definiteness,  suppose 
that  the  parameter  values  are  given  as  in  Table  1. 

We  examine  a  full-factorial  representation  of  all  levels  of  these  parameters  in  combination 
with  each  other,  yielding  a  total  of  288  settings.  Using  exact  computations,  we  find  the 
corresponding  288  optimal  ( s,S )  policies.  Next,  using  standard  curve-fitting  techniques  on 
these  288  pairs  (s,S),  we  obtain  numerical  approximations  for  the  quantities  /)=5-s  and  s. 
Specifically,  according  to  Ehrhardt,  we  obtain  the  formulas 

D  =  (1.463V364  (K/h)  498x 
[U  +  Do-1]06” 
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and 


where 


6-  =  U+1)m  +  (a  +  1 VI  416x 

(a2//*)  603^*). 


U(z)  -  .182/r  +  1.142— 3.466z 

1 1/2 

H3bA(K/h)m 


(1  +  -f)  [(L  +  Do-2]  431 
h 


TABLEJ  —  System  Parameters 


Factor 

Levels 

Number 
of  Levels 

Demand  Distribution 

Poisson  (o-2/m“1) 

Negative  Binomial  (  <r2/p= 3  ) 
Negative  Binomial  (  o-2/V=  9  ) 

3 

Mean  Demand  p 

2,  4,  8,  16 

4 

Replenishment  Leadtime  L 

0,  2,  4 

3 

Replenishment  Setup  Cost  K 

32,  64 

2 

Unit  Penalty  Cost  p 

4,  9,  24,  99 

4 

Unit  Holding  Cost  h 

1 

1 

To  test  whether  this  approximation  is  close  enough  (near  optimal),  we  derive  the  288 
approximate  (s,S)  pairs,  calculate  their  corresponding  expected  cost  using  exact  formulas,  and 
compare  the  associated  cost  with  the  original  optimal  cost.  In  this  design,  95%  of  the  288  cases 
are  within  1%  of  optimal.  Then  we  examine  the  robustness  of  the  approximation  by  trying  a 
number  of  interpolated  and  extrapolated  sets  of  p  rameter  values.  (In  such  tests,  we  had 
equally  good  results.) 

Thus  the  curve-fitting  exercise  provides  the  systems’s  designer  with  an  easily  computed 
replenishment  rule  that  depends  on  the  economic  parameters  and  only  the  mean  and  variance 
of  demand.  But  since  the  mean  and  variance  are  not  known  in  real-life  applications,  the  next 
step  is  to  ascertain  how  well  the  approximation  works  in  a  statistical  environment. 

Presumably,  in  an  actual  situation  the  mean  and  variance  of  demand  for  each  item  would 
be  estimated  by  the  usual  statistical  techniques,  that  is,  by  computing  a  sample  mean  and  vari¬ 
ance  from  a  limited  history  of  data,  and  substituting  these  values  into  the  approximation  formu¬ 
las.  Again  for  the  sake  of  definiteness,  suppose  that  the  designer  wishes  to  investigate  three 
possibilities:  updating  s  and  5  (by  recomputing  the  historical  mean  and  variance  of  demand) 
every  13  weeks,  or  every  26  weeks,  or  every  52  weeks. 


ft 


We  can  test  the  performance  of  the  approximation  rule  under  these  different  cir¬ 
cumstances  by  running  a  computer  simulation  for  each  possibility.  In  particular,  we  again  can 
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choose  a  factorial  design  for  the  parameter  settings,  simulate  the  use  of  the  rule  for  a 
sufficiently  long  history  and  for  each  of  the  three  revision  possibilities,  and  at  the  same  time 
simulate  the  retrospective  approach  to  predicting  the  future  performance  of  the  rule.  In  sum¬ 
mary,  we  found  that  systems  costs  increase,  on  the  average,  by  20%  above  the  optimal  with 
complete  information  when  only  13  weeks  of  data  are  used  and  variance/mean  =  9;  by  11.5% 
when  26  weeks  are  used;  and  by  6.3%  when  52  weeks  are  used.  For  these  same  three  cases, 
the  forecast  of  systems  cost  performance  are,  respectively,  25.1%,  17.1%,  and  10.7%  under  \ he 
actual  values;  interestingly  though,  most  of  the  underestimation  comes  from  the  service 
(stockout  cost)  component,  and  the  separate  predictions  of  inventory  and  replenishment  costs 
are  typically  less  than  2%  under  the  actual  values. 

Finding  Systems  Response  Functions 

Next  we  are  ready  to  obtain  simple-to-use  analytic  expressions  for  the  total  costs  of  using 
the  approximate  policies.  We  again  employ  for  this  purpose  a  curve-fitting  approach.  For  the 
situation  in  which  the  mean  and  variance  can  be  exactly  specified,  we  derive 

Total  Cost  =  5.663 /?/i  4495(I  +  1)  ™\p/ h)~ 91101 "  +  xiS1(.K/h)  203, 

assuming  that  variance/mean  =*  9.  Similarly,  when  26  weeks  of  data  are  used  to  estimate  the 
mean  and  variance,  we  find 

Total  Cost  -  3.7986/x  4309(L  +  1  )  m*{p/h)  2550{K/h)  '9'1. 

These  cost  functions  provide  the  needed  wedge  into  the  problem  of  answering  senior 
management’s  questions  about  forecasts.  To  illustrate,  if  mean  demand  doubles,  total  cost  will 
increase  by  20%  in  both  cases.  If,  for  example,  the  demands  from  eight  independent  and  ident¬ 
ical  warehouses  are  consolidated  in  a  single  central  warehouse,  total  cost  will  be  reduced  by 
about  68%  in  both  cases.  If  service  protection  is  increased  from  0.9  in-stock  probability  to  0.95, 
it  can  be  demonstrated  that  total  cost  will  rise  by  25%  in  the  statistical  environment.  If  lead- 
time  is  cut  in  half  at  the  expense  of  doubling  setup  cost,  then  total  cost  in  a  statistical  environ¬ 
ment  is  reduced  by  7%  ( after  the  higher  setup  costs  are  paid).  If  the  system  is  updated  only 
half  as  often,  total  costs  may  be  reduced  substantially;  for  example,  if  inventory  costs  are 
charged  on  end-of-the-review-period  levels  (as  is  frequently  done  for  the  property  tax  valuation 
component),  the  cost  reduction  is  near  40%. 

The  above  discussion  has  focused  on  total  costs,  but  similar  systems-wide  approximations 
have  been  derived  for  each  of  the  components  of  total  cost  and  other  operating  characteristics. 

Summary 

What  this  abbreviated  survey  of  recent  inventory  research  advances  has  demonstrated  is 
the  way  in  which  seemingly  intractible  mathematical  problems  can  be  solved  by  empirical  and 
statistical  investigation.  Like  any  experimental  approach,  the  suggested  research  strategy 
requires  careful  prior  planning  and  sufficient  completion  time.  The  impressive  tightness  of  the 
approximations,  however,  is  encouraging. 

EXPECTATIONS  FOR  THE  FUTURE 

Perceiving  the  Sector  Factor 

Unquestionably  there  are  important  differences  between  the  private  and  public  sectors  in 
solving  real  logistics  problems.  The  obvious  differences  are  related  to  the  sheer  possibility  of 
truly  integrating  separate  logistics  functions,  the  limited  budgetary  and  personnel  resources  for 
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systems  redesign,  and  the  fiscal  constraints  on  any  implied  multiyear  spending.  Beyond  these 
are  differences  in  the  basic  missions  of  the  logistics  function.  In  a  commercial  enterprise,  the 
logistics  decisions  support  the  buying,  making,  and  selling  functions  and  rather  clearly  lead  to 
an  eventual  profit-and-loss  impact.  But  in  a  military  environment,  the  logistics  mission  is 
highly  intertwined  with  the  critical  notion  of  combat  readiness,  which  in  the  final  analysis  is 
only  rarely  tested  and  then  under  crisis  circumstances.  Perhaps  ironically,  it  is  in  a  military  set¬ 
ting  that  the  top-down  approach  to  logistics  is  most  essential,  because  very  large  sums  of  dollars 
are  committed  by  the  logistics  decisions,  and  these  must  be  balanced  off  against  dollars  spent 
on  other  military  readiness  functions. 

Watching  the  Sign  Posts 

A  truly  telltale  criticism  of  past  management  science  and  operations  research  investiga¬ 
tions  into  logistics  functions  is  that  they  rarely  reflect  timely  economic  issues.  To  illustrate,  one 
is  hard  pressed  to  find  in  the  applied-mathematics-oriented  logistics  research  literature  a  careful 
discussion  of  the  impact  of  inflation,  the  limited  availability  of  fuels  and  other  strategic 
resources,  or  the  rate  of  technological  change.  However,  actual  logistics  managers  are  painfully 
aware  of  these  environmental  changes  and  their  impact  on  logistics  decisions.  Logistics 
research  will  only  stay  vital  if  it  pays  heed  to  the  changing  world. 

Generating  Viable  Options 

It  is  virtually  a  tautology  to  say  that  a  formal  logistics  decision  model  encompasses  a  static 
universe  of  options.  The  solution  drawn  from  this  universe  by  the  model  may  or  may  not  yield 
a  recommendation  that  can  be  implemented,  but  if  the  solution  is  unacceptable  the  analyst 
always  can  go  back  to  the  drawing  board,  revise  the  model,  and  try  again.  What  is  more  impor¬ 
tant  to  the  search  for  significant  progress  in  logistics  decisionmaking  is  to  concentrate  on  dis¬ 
covering  truly  new  options.  Without  sinking  into  a  philosophical  quagmire  of  subtle  distinc¬ 
tions,  we  suggest  that  analysts  pay  more  attention  to  relieving  constraints,  finding  new  concep¬ 
tions  and  criteria,  combining  separate  processes,  and  so  forth  than  to  searching  for  the  very  best 
answer  within  a  well-established  framework  of  concepts,  laid  down  constraints,  and  cir¬ 
cumscribed  functions. 

Substitution  at  the  Margins 

A  related  topic  is  the  necessity  that  a  wide  view  be  taken  of  the  important  substitution 
possibilities.  For  example,  there  are  tradeoffs  between  computer  information  systems  and 
skilled  labor,  between  large  stocks  of  disposable  spares  and  limited  stocks  of  high-technology 
components,  between  fast  modes  of  transport  and  extensive  amounts  of  inventory,  and 
between  rapid  communications  systems  and  multiple  pipelines,  to  name  a  few.  The  point  is  so 
obvious  that  it  may  not  seem  worth  making,  except  that  most  logistics  research  takes  place  in  a 
very  limited  context.  The  analyst  may  be  either  proscribed  from  examining  such  tradeoffs  or 
ignorant  of  their  existence  and  feasibility.  Thus,  one  function  of  senior  management  is  to 
encourage  logistics  staffs  not  to  be  too  circumscribed  in  considering  possibilities.  An  ancillary 
observation  is  that  a  logistics  organization  making  such  investigations  must  have  access  to  a 
broad  spectrum  of  skills  and  knowledge. 

Next  Up 


In  summary,  this  survey  has  attempted  to  realistically  assess  both  the  strengths  and  the 
limitations  of  logistics  research  to  date  and  to  generate  excitement  and  enthusiasm  for  the 
worthwhile  but  difficult  tasks  ahead.  Our  prognosis  is  that  substantial  advancements  will  be 
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made  in  the  coming  decade  by  researchers  who  focus  on  problems  at  the  traditional  boundaries 
of  the  logistics  functions,  who  keep  abreast  of  the  changing  outside  environment,  and  who 
break  away  from  sole  reliance  on  the  well-worn  applied  mathemathics  techniques  that  have 
already  run  their  courses  with  regard  to  many  now-classic  logistics  problems.  None  of  our 
exhortations  is  meant  to  detract,  however,  from  the  unassailable  value  of  building  on  past 
research  momentum.  We  have  tried,  rather,  to  indicate  where  we  think  some  of  the  still-buried 
great  treasures  are  to  be  found  in  the  next  10  years  of  logistics  research. 
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ABSTRACT 

Toial  lime  on  lesl  <TTT>  plots  provide  a  useful  graphical  method  for  tenta¬ 
tive  identification  of  failure  distribution  models.  Identification  is  based  on  pro¬ 
perties  of  the  ITT  transform.  New  properties  of  the  TTT  transform  distribu¬ 
tion  are  obtained.  These  results  are  useful  to  the  user  of  TTT  plots.  Although 
IFR  (DFR)  distributions  are  particularly  easy  to  identify  from  TTT  plots,  the 
user  must  exercise  caution  relative  to  identification  of  IFRA  (DFRA)  distribu¬ 
tions. 


1.  INTRODUCTION 

The  geometry  of  the  total  time  on  test  transform  is  helpful  in  interpreting  total  time  on 
test  data  plots  [1].  In  particular,  it  is  possible  to  infer  tentative  probabilty  distribution  models 
based  on  total  time  on  test  plots. 

Let  F  be  a  failure  distribution,  i.e.,  F(0~)  -  0  and  F  -  1  -  F.  Define 
fifHi)  -  f0F-'U)  F(x)dx  0  ^  f  <  1  , 

the  total  time  on  test  transform  of  F.  It  is  easy  to  verify  that,  //f,  the  inverse  of  Hf]  is  a  distri¬ 
bution  function.  Also,  //has  support  in  tO,0l  if  0  is  the  mean  of  F,  since 

J* f''0)  F(x)dx  -  /"  xdF(x)  -  0 

Jo  Jo 

by  an  integration  by  parts.  It  is  easy  to  verify  that  if  F(x)  -  1  -  e'*'",  then  the  corresponding 
Hf(x)  -  x/0  for  0  <  x  <  0.  The  result  that  our  transform  carries  the  exponential  distribution 
into  the  rectangular  distribution  on  [0, 0]  is  important. 

As  was  proved  in  Barlow,  Bartholomew,  Bremner  and  Brunk  (2],  total  time  on  test  data 
plots  tend  to  the  total  time  on  test  transform  of  the  underlying  failure  distribution  as  the  sam¬ 
ple  size  tends  to  infinity.  In  order  to  interpret  total  on  test  data  plots,  we  need  to  understand 
the  relationship  between  Fand  its  transform.  The  following  table  summarizes  the  connections. 


•This  research  has  been  partially  supported  by  the  Office  of  Naval  Research  under  Contract  NOOOI4-7S-C-7081  and  the 
Air  Force  Office  of  Scientific  Research  (AFSC),  USAF,  under  Grant  AFOSR-77-3179  with  the  University  of  California. 
Reproduction  in  whole  or  in  part  is  permitted  for  any  purpose  of  the  United  States  Government. 

This  is  part  of  a  chapter  in  the  forthcoming  volume  Inference  and  Dam  Analysis  for  Reliability  and  Life  Testing  with  Frank 
Proschan. 
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TABLE  1  —  Logical  Connections  Between  Life  Distributions, 
Hazard  Functions  and  TTT  Transform  Distributions 


Life  Distribution 

F 

1 

1 

1 

Hazard  Function 

R  —  —log  F 

1 

1 

1 

Total  Time  on  Test 
Transform  Distribution 
Hf 

Exponential 

linear 

linear 

IFR 

convex 

convex 

DFR 

<+*■ 

concave 

concave 

IFRA 

starshaped 

-*> 

starshaped 

DFRA 

anti-starshaped 

-*> 

anti-starshaped 

u(X) 

A  function  g  defined  on  [0,6)  such  that  - -  is  nondecreasing  on  [0,6)  is  said  to  be 

x 

starshaped  with  respect  to  the  origin.  If  G(x)  -  1  -  e~x ,  then  F is  IFRA  (for  increasing  failure 


rate  average)  if  and  only  if 


G~'F(x) 


is  nondecreasing  for  0  <  x  <  F  '(1).  The  function 


G~'F(x)  —  R(x)  is  said  to  be  starshaped  with  respect  to  the  origin.  As  the  last  two  implica¬ 
tions  indicate,  IFRA  and  DFRA  distribution  families  are  not  characterized  by  corresponding 
properties  of  the  TTT  transform  distribution.  However  IFR  and  DFR  distribution  families  are 
characterized  by  corresponding  properties  of  the  TTT  transform  distribution. 


To  verify  the  implications  in  the  table  for  the  IFR  (DFR)  case,  first  assume  F  absolutely 
continuous  with  failure  rate  function,  r.  If  F is  IFR  (DFR),  then 


d_ 

dt 


Hf'U) 


I i-F(x) 


1 

r(x) 


is  decreasing  (increasing)  in  x  which  implies  Hf 1  is  concave  (convex),  i.e.,  HF  is  convex  (con¬ 
cave).  Conversely,  if  Hf 1  is  concave  (convex),  the  failure  rate  function  is  increasing  (decreas¬ 
ing).  To  see  this,  note  that  every  IFR  (DFR)  distribution  can  be  approximated  arbitrarily 
closely  by  an  absolutely  continuous  IFR  (DFR)  distribution.  Since  the  limit  of  a  sequence  of 
concave  (convex)  transforms  is  concave  (convex)  on  [0,11,  it  follows  that  F  is  IFR  (DFR)  if 
and  only  if  Hf 1  is  concave  (convex). 

The  IFRA  distributions  govern  the  lifelength  of  coherent  systems  with  statistically 
independent  components  whose  life  distributions  are  IFR  (or,  more  generally,  IFRA).  (Birn- 
baum,  Esary  and  Marshall  [3]  or  Barlow  and  Proschan  [4].  They  also  arise  in  other  reliability 
contexts.  For  these  reasons,  we  are  interested  in  the  transforms  of  IFRA  distributions.  In  the 
next  section  we  show  that  if  /"is  IFRA,  then  its  transform  distribution,  HF,  is  starshaped;  i.e., 
Hr(x) 

- is  nondecreasing  in  0  <  x  <  9.  Unfortunately,  the  converse  is  not  true. 


Bergman  [5]  and  Mark  Brown  (personal  communication)  have  pointed  out  that  F  is  New 
Better  than  Used  in  Expectation  (NBUE);  i.e. 


F_(u) 

Fix) 


du  ^  n 


x  >  0 


if  and  only  if 


Hf'  (t)  - 


X 


F-'(r) 


F(u) 

u- 


du  ^  t 


0  <  /  <  1 
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where  n  is  the  mean  of  F.  (To  see  this,  let  /  -  Fix)  and  make  a  change  of  variable  using  the 
fact  that  m  “  F(u)du.)  The  NBUE  class  properly  contains  the  IFRA  class.  Hence  if  the 

•rO  _ 

TTT  plot  is  anti-starshaped,  it  necessarily  lies  above  the  45°  line  and  this  is  evidence  that  F  is  at 
least  NBUE  if  not  IFRA. 

2.  PRESERVATION  OF  PARTIAL  ORDERINGS  ON  CLASSES 
OF  FAILURE  DISTRIBUTIONS 

Let  Rix)  -  -logFix)  be  the  hazard  function  of  F  as  before  and  let  G(x)  —  1  -  e~x. 
Observe  that  G~'F(x)  -  R(x)  so  that  if  F  is  IFR,  G_1F(x)  is  convex  on  the  support  of  Fand 

conversely.  If  Fis  IFRA,  - -  is  nondecreasing  in  x  ^  0  and  conversely.  This  leads  to  a 

partial  ordering  on  the  space  of  failure  distributions  which  we  call  "star  ordering."  Let  J  be  the 
class  of  continuous  distributions  on  [  0,  °°)  and  {deg.},  the  class  of  degenerate  distributions. 


DEFINITION: 

F\  </2 ,(  i.e.,  is  star  ordered  with  respect  to  F2  if  F^F^JU  (deg.)  and  - — - is  non- 

decreasing  in  x  for  0  <  x  <  Ff1  (1)  ). 

According  to  this  definition,  every  distribution  in  ?  is  star  ordered  with  respect  to  a 
degenerate  distribution.  Let  F„  (x)  -  1  -  e~*“  for  x  >  0  and  a>0.  It  is  easy  to  show  that  if 
0  <  a,  <«2,  then  F„  < F„  .  Since  Fa  has  failure  rate  ox"'1,  it  is  clear  that  the  failure  rate  of 
F,2  is  "increasing  faster"  than  the  failure  rate  of  Fa|.  If  0  <  a  <  1,  Fa  is  DFR.  If  a  >  1,  Fa  is 
IFR  and  F,  is  exponential. 


DEFINITION 

F,  <  F2  (  i.e.,  F |  is  convex  ordered  with  respect  to  F2  if  Fi.F^Ju  {deg.}  and  F2~'  Fi(x) 
c 

is  convex  in  x  for  0  <  x  <  Ff 1  (1)  ). 

It  is  not  hard  to  show  that  c-ordering  implies  star  ordering,  but  not  conversely.  Our  main 
theorem  is  that  the  TTT  transform  distribution  preserves  both  orderings. 


THEOREM  2.1: 

Let  F,.F2«£ 

(a)  If  F)  <  F2,  then  Hf  <  HF , . 

c  '  c  ‘ 

(b)  If  F,  </2,  then  //f|  <HFi. 

The  following  corollary  provides  the  primary  application  of  the  theorem. 


COROLLARY  2.2: 


If  F|,F2  *  ?  and  F|<F2,  then 
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(a) 


Hf2'  </> 

<0 


is  nondecreasing  in  <  1; 


(b) 


hf-'  (/) 

Hr~'(  1) 


Hf2'  U) 

Hf~'  0) 


for  0  ^  i  <  1. 


PROOF  OF  COROLLARY: 

HF-iHFl  (x) 

By  Theorem  2.1,  Part  (b),  HFi<tHF2  so  -  is  nondecreasing  in 

0  <  x  <  Ff1  (1).  Let  /  -  //f|(x)  and  Part  (a)  of  the  corollary  is  immediate,  (b)  is  a  trivial 
consequence  of  (a).  |  | 

Figures  1  and  2  are  graphical  plots  of  the  scaled  transforms  of  gamma  and  Weibull  distri¬ 
butions.  They  visually  confirm  Part  (b)  of  the  corollary.  Figure  3  shows  the  same  ordering  as 
in  Figures  1  and  2  with  respect  to  the  shape  parameter  of  a  lognormal  distribution  although  this 
distribution  is  neither  1FRA  nor  DFRA. 


FlOURF  1.  Gamma  distribution  (shape  parameter  o) 


TOTAL  TIME  ON  TEST 


Seated  Tout  Tima  on  Test  Transform* 


Figure  2.  Weibull  distribution  (shape  parameter  0) 


PROOF  OF  THEOREM  2.1 


(a)  Assume  F\<  F2.  We  wish  to  show  Hf^  //f|(x)  is  convex  in  0  ^  x  ^  F\  ' 
First  assume  F\  and  F2  are  absolutely  continuous.  Then  we  need  only  show 
..-if..  ,  d  C 


F2  (u)du  is  nondecreasing  in  0  <  x  <  F\  1  (1).  Now 


S-k 
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Scaled  Total  Timas  on  Test  Transforms 

Figure  3.  Lognormal  distribution  (shape  parameter  <r) 


Hence 


dHf{(x)  df  /,[Fr'//f|(x)]  d  /,[Fr'//fi(x)] 

dx  dx  ”  1  -  HFx(x)  3nd  dx  Jo  F2(u)du  -  ^  (x)] 


But  F{  <  F2  implies 
c 


±  r-1  r  (x)  . 

2  1  U FflF,(x)l 


is  nondecreasing  in  0  <  x  <  Fj  ’(1).  Since  F)  1  //f[(x)  is  nondecreasing  in  0  <  x  < 
Ff'  (1),  a  change  of  variable  completes  the  argument. 

Since  continuous  distributions  can  be  approximated  arbitrarily  closely  by  absolutely  con¬ 
tinuous  distributions,  the  proof  of  part  (a)  is  complete. 

To  prove  (b)  we  will  need  the  following  fundamental  lemma. 
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FUNDAMENTAL  LEMMA  2.3: 

O  /  V  \  | 

If  Ri 0)  -  0, - -  is  nondecreasing  in  x  >  0  and  0  <  Nix)  <  —  f  Niu)du ,  then 

X  X  Jo 

(2.1)  X  Nju)dRju) 

X  A/(u)rfu 

is  nondecreasing  in  x  >  0.  [Note  that  if  )V(x)  is  nonincreasing,  the  assumption  on  W(x)  is 
automatically  satisfied.  For  example,  Nix)  could  be  the  number  surviving  to  time  x.] 


PROOF: 

R  can  be  approximated  arbitrarily  closely  from  below  by  positive  linear  combinations  of 
simple  functions  of  the  form 


Rix) 


0  *<*,. 
x  x  ^  x0. 


Hence  we  need  only  verify  the  lemma  for  simple  functions.  The  general  result  follows  from 
the  Lebesgue  monotone  convergence  theorem.  For  a  simple  function,  R 


f  Niu)dR(u) 
f*N(u)du 


0 


x<x0 


Hence,  for  x  >  x0 


X  N(u)dRiu) 
So  H(u)du 


x0yV(x0)  +  f  Niu)du  x  ^  xo- 
%,xo 

So  N(u^du 

J*  v0 

0  Niu)du 


=  1  + 


So  N^du 


1  rx  o 

By  assumption,  A'(xq)  <  —  I  Niu)du  so  that  the  lemma  follows. 

X0  ■'0 


THEOREM  2.1,  PART  (B): 


Let  Rix)  =  F2  1 Z7! (x) .  By  assumption,  is  nondecreasing  in  0  <  x  <  Ff'(l). 


Let  N(u)  =  F\iu),  x  =  F\  1  it)  and  substitute  in  (2.1)  to  obtain 


X 


f  f1  to 


F\iu)dRiu) 


, F.-'U ) 


So  '  F' {u)du 


Let  v  =  Fi'  F\iu)  =  Riu)  so  that  the  numerator  becomes  |  FAu)  dRiu) 

rFi',,)  - 

J  F2iv)dv.  It  follows  from  the  Fundamental  Lemma  that 


.  -tin,  *•*> 
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HF'  (t)  f  F2(v)dv 


is  nondecreasing  in  0  <  /  <  1  or 


Hf  HfM) 


is  nondecreasing  in  0  <  x  ^  F,  1  (1),  i.e.. 


^,<.^•11 

HF|  <  Hf2  does  not  imply  f,  <  f2 

Let  G(x)  =  1—  e~x  so  that  Hc(x)  =  x  for  0  <  x  ^  1.  It  is  easy  to  find  examples  such 
that  HF  <  H(;  but  F  G\  i.e.,  F  is  not  IFRA.  Note  that  for  0  <  t,  <  1, 
c  =  -/og(l -/,)—*!  >  0.  Hence 


is  not  IFRA  since 


F(x) 


R(x) 


1  0  <  x  <  r, 

t>-(r+jr)  x  3s  r. 


0  0  <  x  <  r, 

-+1  *  3s  fi 

x 


is  decreasing  for  x  > 
But 


HF'(t) 


0  ^  /  <  r, 
/,  <  t  <  1* 


is  anti-starshaped;  i.e.,  - - - is  nonincreasing  in  0  <  t  <  1  so  that  HF<HG  . 


The  significance  of  this  example  is  that  an  anti-starshaped  total  time  on  test  plot  is  not 
necessarily  evidence  that  Fis  IFRA. 

3.  A  MEASURE  OF  IFRness 

Figures  1  and  2  show  scaled  total  time  on  test  transformations  for  various  parametric  fam¬ 
ilies  of  failure  distributions.  In  each  case  a  single  shape  parameter  provides  a  measure  of  depar¬ 
ture  from  exponentiality. 

c  i 

By  Part  (b)  of  Corollary  2.2,  the  area  I  HF'(u)du  could  also  provide  a  measure  of 

oo  — 

xdF\(x)  *  f  xdF^ix ),  then 
0  *'0 

X  Hf<  (u)du  >  X  {u)du  ■ 

Ji  i 

0  HFl(u)du  -  xdHr(x),  so  that  the  mean  of  HF ,  the  inverse  of 
the  transform  of  F  provides  a  measure  of  the  IFRness  of  F.  The  following  lemma  provides  an 

0  xdHf(x). 
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LEMMA: 

If  f  xdF(x)  <  Chen 

Jo”  xdHfix)  -  2  Jo°°  x[\  -  F(x)]dF(x)  . 

PROOF: 

J»°°  l 

0  xdHy(x)  —  Jn  HF'(u)du,  we  integrate  the  latter  by  parts  of  obtain 

J *  Hj~x(u)du  =  X  F~'(u)du  -  X  / ( 1  -  l)dF~'(l)  . 
Integrate  by  parts  again  to  obtain 

-f  r(l  -  t)dr'(t)  *  f'  f-'(M)(l  -  2u)du 

•'0  J  o 

so  that 

H?lU)dt-  2  /J  (1  -  u)r'{u)du  =*  2  X"  Jrll  - /(jf))</f(*) 

by  a  change  of  variable  !  | 


EXAMPLES: 


For  F(x)  =  1  —  e  Ux)“  with  mean, -say  0, 

7  X”  xdHr(x)  =  l/2'/“  . 


For  the  gamma  distribution 


with  mean  0  =  — , 
\ 


F(x)  =  X 

Jo 


AV-’g-*" 
(A  -  1)! 


du  , 


k  =  1,2,  ... 


7  Xo  =  X 


i-0 


i+k 

k 


1 

2>+* ' 


1  /•“ 

The  numerical  relationship  between  —  I  xdHF(x)  and  the  shape  parameter  for 

0  •'0 


Weibull  and  gamma  distributions  is  shown  in  the  following  table.  This  is  one  way  of  relating 
Weibull  and  gamma  distributions.  The  basic  distinction  between  Weibull  and  gamma  distribu¬ 
tions  lies  in  the  behavior  of  their  respective  failure  rates  for  large  values  of  the  time  variable. 
Comparing  Figures  1  and  2,  we  see  that  the  gamma  transform  is  nearly  linear  for  t  ^  .50  while 
the  Weibull  transform  still  exhibits  curvature  for  t  ^  .50. 
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TABLE  2  —  Relationship  Between  Measures  of“lFRnesf 


7  So  xdHf{x) 

Weibull 

a 

Gamma 

k 

.20 

.43 

.25 

.50 

.30 

.58 

.35 

.66 

.40 

.lb 

.45 

.87 

.50 

1 

1 

.55 

1.16 

.60 

1.36 

.63 

1.50 

2 

.65 

1.61 

.69 

1.87 

3 

.70 

1.94 

.73 

2.20 

4 

.75 

2.41 

5 

.80 

3.11 

.85 

4.27 

.90 

6.58 

.95 

13.51 
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ABSTRACT 

A  simple  and  relatively  efficient  method  for  simulating  one-dimensional  and 
two-dimensional  nonhomogeneous  Poisson  processes  is  presented  The 
method  is  applicable  for  any  rate  function  and  is  based  on  controlled  deletion 
of  points  in  a  Poisson  process  whose  rate  function  dominates  the  given  rate 
function.  In  its  simplest  implementation,  the  method  obviates  the  need  for  nu¬ 
merical  integration  of  the  rate  function,  for  ordering  of  points,  and  for  genera¬ 
tion  of  Poisson  variates 


1.  INTRODUCTION 

The  one-dimensional  nonhomogeneous  Poisson  process  (see  e.g.  16],  pp.  28-29;  (4],  pp. 
94-101)  has  the  characteristic  properties  that  the  numbers  of  points  in  any  finite  set  of  nonover¬ 
lapping  intervals  are  mutually  independent  random  variables,  and  that  the  number  of  points  in 
any  interval  has  a  Poisson  distribution.  The  most  general  nonhomogeneous  Poisson  process 
can  be  defined  in  terms  of  a  monotone  nondecreasing  right-continuous  function  Nix)  which  is 
bounded  in  any  finite  interval.  Then  the  number  of  points  in  any  finite  interval,  for  example 
(0,  x0],  has  a  Poisson  distribution  with  parameter  /x0  =  A(x0)  -  A(0).  In  this  paper  it  is 
assumed  that  \(x)  is  continuous,  but  not  necessarily  absolutely  continuous.  The  right  deriva¬ 
tive  A(x)  of  A  Or)  is  called  the  rate  function  of  the  process;  A(x)  is  called  the  integrated  rate 
function  and  has  the  interpretation  that  for  x  >  0.  A(x)  -  A(0)  =  £[N(x)],  where  Nix)  is 
the  total  number  of  points  in  (0,  x].  Note  that  \(x)  may  jump  at  points  at  which  A(x)  is  not 
absolutely  continuous.  In  contrast  to  the  homogeneous  Poisson  process,  i.e.,  \(x)  is  a  constant 
(usually  denoted  by  A),  the  intervals  between  the  points  in  a  one-dimensional  nonhomogene¬ 
ous  Poisson  process  are  neither  independent  nor  identically  distributed. 

Applications  of  the  one-dimensional  nonhomogeneous  Poisson  process  include  modelling 
of  the  incidence  of  coal-mining  disasters  (6),  the  arrivals  at  an  intensive  care  unit  (12),  transac¬ 
tion  processing  in  a  data  base  management  system  [14],  occurrences  of  major  freezes  in  Lake 
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Constance  (20],  and  geomagnetic  reversal  data  [19].  The  statistical  analysis  of  trends  in  a  one¬ 
dimensional  nonhomogeneous  Poisson  process,  based  on  the  assumption  of  an  exponential 
polynomial  rate  function,  is  discussed  by  [6],  15],  [12],  and  [14], 

There  are  a  number  of  methods  for  simulating  the  nonhomogeneous  Poisson  process 
which  we  review  briefly 

(i)  Time-scale  transformation  of  a  homogeneous  (rate  one)  Poisson  process  via  the  inverse 

of  the  (continuous)  integrated  rate  function  A(x)  constitutes  a  general  method  for  gen¬ 
eration  of  the  nonhomogeneous  Poisson  process  (cf.,  [4],  pp.  96-97).  This  method  is 
based  on  the  result  that  A"),  X 2 . are  the  points  in  a  nonhomogeneous  Poisson  pro¬ 

cess  with  continuous  integrated  rate  function  \(x)  if  and  only  if  X]  =  A(A”|), 

X'j  =  AfA'j) . are  the  points  in  a  homogeneous  Poisson  process  of  rate  one.  The 

time-scale  transformation  method  is  a  direct  analogue  of  the  inverse  probability  integral 
transformation  method  for  generating  (continuous)  nonuniform  random  numbeis.  For 
many  rate  functions,  inversion  of  A(x)  is  not  simple  and  must  be  done  numerically;  cf., 
[7]  and  [17],  The  resulting  algorithm  for  generation  of  the  nonhomogeneous  Poisson 
process  may  be  far  less  efficient  than  generation  based  on  other  methods;  see  e  g.,  [13], 
[15],  and  [17]  for  discussions  of  special  methods  for  efficiently  generating  the  nonhomo¬ 
geneous  Poisson  process  with  log-linear  and  log-quadratic  rate  functions. 

(ii)  A  second  general  method  for  generating  a  nonhomogeneous  Poisson  process  with 
integrated  rate  function  \(x)  is  to  generate  the  intervals  between  points  individually,  an 
approach  which  may  seem  more  natural  in  the  event-scheduling  approach  to  simulation. 

Thus,  given  the  points  A']  —  Xj,  X2  —  x2 . X,  x,,  with  X\  <  X2  <  . . .  <  X,,  the 

interval  to  the  next  point,  Jf,+1  -  X,,  is  independent  of  X| . x,_i  and  has  distribution 

function  Fix)  =  1  —  exp[—  (A(x,  +  x)  —  A(x,))].  It  is  possible  to  find  the  inverse  distri¬ 
bution  function  F~'(),  usually  numerically,  and  generate  Xl+i  -  X,  according  to 
Af,+I  —  X,  “  F~liU,),  where  t/,  is  a  uniform  random  number  on  the  interval  (0,1).  Note, 
however,  that  this  not  only  involves  computing  the  inverse  distribution  function  for  each 
interval  A',+i  —  Xn  but  that  each  distribution  has  different  parameters  and  possibly  a 
different  form.  An  additional  complication  is  that  A',+)  -  X,  is  not  necessarily  a  proper 
random  variable,  i.e.,  there  may  be  positive  probability  that  Afl+1  -  A",  is  infinite.  It  is 
necessary  to  take  this  into  account  for  each  interval  Xl+l  -  X,  before  the  inverse  proba¬ 
bility  integral  transformation  is  applied.  The  method  is  therefore  very  inefficient  with 
respect  to  speed,  more  so  than  the  time-scale  transformation  method. 

(iii)  In  a  third  method,  simulation  of  a  nonhomogeneous  Poisson  process  in  a  fixed  interval 

(0,  x0]  can  be  reduced  to  the  generation  of  a  Poisson  number  of  order  statistics  from  a 
fixed  density  function  by  the  following  result  (cf.,  [6],  p.  45).  If  AV  X2,  ,  Xn  are  the 

points  of  the  nonhomogeneous  Poisson  process  in  (0,x0],  and  if  Nix0)  «  n ,  then  condi¬ 
tional  on  having  observed  n(>  0)  points  in  (0,  x0],  the  A",  are  distributed  as  the 
order  statistics  from  a  sample  of  size  n  from  the  distribution  function 
(A(x)  -  A (0) )/( A  (jc0)  -  A(0)},  defined  for  0  <  x  <  x0.  Generation  of  the  nonhomo¬ 
geneous  Poisson  process  based  on  order  statistics  is  in  general  more  efficient  (with  respect 
to  speed)  than  either  of  the  previous  two  methods.  Of  course,  a  price  is  paid  for  this 
greater  efficiency.  First,  it  is  necessary  to  be  able  to  generate  Poisson  variates,  and 
second,  more  memory  is  needed  than  in  the  interval-by-interval  method  in  order  to  store 
the  sequence  of  points.  Enough  memory  must  be  provided  so  that  with  very  high  proba¬ 
bility  the  random  numbers  of  points  generated  in  the  interval  can  be  stored.  Recall  that 
the  number  of  points  in  the  interval  (0,  x0]  has  a  Poisson  distribution  with  mean 
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Mo  ”  A(x0)  —  A(0).  Memory  of  size,  e.g..  Mu  +  4mo/j  wll  ensure  that  overflow  will  occur 
on  the  average  in  only  one  out  of  approximately  every  40,000  realizations.  This  probabil¬ 
ity  is  small  enough  so  that  in  the  case  of  overflow,  the  realization  of  the  process  can  gen¬ 
erally  be  discarded. 

(iv)  Again,  there  is  a  very  particular  and  very  efficient  method  for  simulation  of  nonhomo- 
geneous  Poisson  processes  with  log-linear  rate  function  [13]  which,  at  the  cost  of  pro¬ 
gramming  complexity  and  memory,  can  be  used  to  obtain  an  efficient  simulation  method 
for  other  rate  functions,  as  in  [15]. 

In  this  paper  a  new  method  is  given  for  simulating  a  nonhomogeneous  Poisson  process 
which  is  not  only  conceptually  simple,  but  is  also  computationally  simple  and  relatively  efficient. 
In  fact,  at  the  cost  of  some  efficiency,  the  method  can  be  applied  to  simulate  the  given  nor.ho- 
mogeneous  Poisson  process  without  the  need  for  numerical  integration  or  routines  for  generating 
Poisson  satiates.  Used  in  conjunction  with  the  special  methods  given  in  [13]  and  [15],  the 
method  can  be  used  to  generate  quite  efficiently  nonhomogeneous  Poisson  processes  with 
rather  complex  rate  functions,  in  particular  combinations  of  long-term  trends  and  fixed-cycle 
effects.  The  method  is  also  easily  extended  to  the  problem  of  generating  the  two-dimensional 
nonhomogeneous  Poisson  process. 


2.  SIMULATION  OF  ONE-DIMENSIONAL  NONHOMOGENEOUS 
POISSON  PROCESSES 


Simulation  of  a  nonhomogeneous  Poisson  process  with  general  rate  function  A(x)  in  a 
fixed  interval  can  be  based  on  thinning  of  a  nonhomogeneous  Poisson  process  with  rate  func¬ 
tion  A*(x)  ^  A(x).  The  basic  result  is 

THEOREM  1:  Consider  a  one-dimensional  nonhomogeneous  Poisson  process 
[N*(x):x  ^  0}  with  rate  function  A*(x),  so  that  the  number  of  points,  ,V*(x0),  in  a  fixed 
interval  (0,  x0]  has  a  Poisson  distribution  with  parameter  mo“A*(x0)  -  A*(0).  Let 
X*.  X 2,  ....  X%nXoj  be  the  points  of  the  process  in  the  interval  (0,x0].  Suppose  that  for 
0  <  x  ^  Xo,  A(x)  ^  A*(x).  For  /  =  1,  2 delete  the  point  X *  with  probability 
1  ~  A(A'^/\*(A'^;  then  the  remaining  points  form  a  nonhomogeneous  Poisson  process 
[N{x):x  >  0}  with  rate  function  A(x)  in  the  interval  (0,x0l. 


PROOF:  Since  (jV*(x):x  ^  0)  is  a  nonhomogeneous  Poisson  process  and  points  are 
deleted  independently,  it  is  clear  that  the  number  of  points  in  (N(x):x  >  0)  in  any  set  of  non¬ 
overlapping  intervals  are  mutally  independent  random  variables.  Thus,  it  is  sufficient  to  show 
that  the  number  of  points  N(a,b)  in  (/V(x)  x  >  0)  in  an  arbitrary  interval  (a,b\  with  0  <  a  < 
b  <  x0  has  a  Poisson  distribution  with  parameter  \(b)  -  A(a).  Observe  that  with 
pia.b)  -  [A (Z>)  —  A(a))/{A*(i).  —  A*(a)},  we  have  the  conditional  probability: 


0) 


P{N(a,b )  -  n\N'(a,b)  =  A) 


1  if  n  -  it  -  0 

Jxj  (p(a, All'll  -  p(a,b)\k~"  if  k  >  n  >  0 

and  k  ^  1 

10  if/r  >  1 

and  k  <  n 
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Equation  (I)  is  a  consequence  of  the  well-known  result  that,  conditional  on  k  (>0)  points  in 
the  interval  (a, 6],  the  joint  density  of  the  k  points  in  the  process  {)V*(x):x  ^  Oj  is 
...  A*(xa)/(A*(/>)  -  A*(a)j*.  The  desired  result  is  obtained  in  a  straightforward 
manner  from  Equation  (1)  by  removing  the  condition. 

Theorem  1  is  the  basis  for  the  method  of  simulating  nonhomogeneous  Poisson  processes 
given  in  this  paper. 

ALGORITHM  1:  One-dimensional  nonhomogeneous  Poisson  process. 


1.  Generate  points  in  the  nonhomogeneous  Poisson  process  (A/*:(x)  ^  0)  with  rate  function 
A*(x)  in  the  fixed  interval  (0,x0l.  If  the  number  of  points  generated,  n*,  is  such  that  n* 
=»  0,  exit;  there  are  no  points  in  the  process  |N(x):x>  0). 

2  Denote  the  (ordered)  points  by  A"*  X* . X*'.  Set  i  =  1  and  k  =  0. 

3.  Generate  U,,  uniformly  distributed  between  0  and  1.  If  U  <  k(X*)/k*(X*),  set  k  equal 
to  k+ 1  and  Xk  —  X * 

4.  Set  /  equal  to  /+1.  If  /  <  n*,  go  to  3. 

5.  Return  X2 . Xn,  where  n  —  k,  and  also  n. 

(i)  In  the  case  where  {Af*(x):x  ^  0}  is  a  homogeneous  Poisson  process  with  A*(x)  =  k* ; 

(ii)  the  minimum  of  A(x),  say  A,  is  known,  and 

(iii)  generation  of  uniformly  distributed  variates  is  computationally  costly, 

considerable  speedup  can  be  obtained  by  noting  that  X*  is  always  accepted  if  U,  <  k/k*.  This 
obviates,  in  some  cases,  computation  of  A(x),  which  is  the  main  source  of  inefficiency  in  the 
algorithm.  Moreover,  in  this  case  k*U,/k  can  be  used  as  the  next  uniformly  distributed  variate. 

The  method  of  thinning  in  this  simple  form,  i.e.,  A*(.v)  =  A*  =  max0^v<Vo  A(x),  can 
also  be  used  to  provide  an  algorithm  for  generating  a  nonhomogeneous  Poisson  process  on  an 
interval-by-interval  basis,  as  discussed  in  subsection  (ii)  of  Section  1.  The  interval  to  the  next 
point  X,+i  —  X,  is  obtained  by  generating  and  cumulating  exponential  (A")  random  numbers 
E* ,  E* . until  for  the  first  time  Uj  <  A(A',  +  £*  +  ...  E*)/k  *  where  the  V,  are  indepen¬ 

dent  uniform  random  numbers  between  0  and  1.  This  algorithm  is  considerably  simpler  than 
the  interval-by-interval  algorithm  of  Section  1  since  it  requires  no  numerical  integration,  only 
the  availability  of  uniform  random  numbers. 


3.  DISCUSSION  OF  THE  METHOD  OF  THINNING 

(i)  Relationship  to  acceptance-rejection  method 

The  method  of  thinning  of  Algorithm  1  is  essentially  the  obverse  of  the  conditional 
method  of  Section  1,  using  conditioning  and  acceptance-rejection  techniques  to  generate  the 
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random  variables  with  density  function  A(x)/{A(x)  —  A(0)|  (Lewis  and  Shedler,  [15],  Algo¬ 
rithm  3).  The  differences  are  subtle,  but  computationally  important.  In  the  acceptance- 
rejection  method,  it  is  first  necessary  to  generate  a  Poisson  variate  with  mean 
ix 0—  A(xq)  —  A(0),  and  this  involves  an  integration  of  the  rate  function  A(x).  Then  the  Pois¬ 
son  (fi0)  number,  n,  of  variates  generated  by  acceptance-rejection  must  be  ordered  to  give 
X,.  X2 . X„. 

(ti)  Simplest  form  of  the  thinning  algorithm 

In  the  simplest  form  of  the  method  of  thinning,  A*(x)  is  taken  to  be  a  constant  A*,  so 
that,  for  instance,  the  points  Af*,  X*.  ...  ,  X *•  can  be  generated  by  cumulating  exponential 
(A  *)  variates  until  the  sum  is  greater  than  x0  (cf.,  [13],  Algorithm  1).  Thinning  is  then  applied 
to  the  generated  points.  No  ordering,  no  integration  of\{x)  and  no  generator  of  Poisson  variates  is 
required.  Of  course  for  both  algorithms  to  be  efficient,  computation  of  A(x)  and  A*(x)  must  be 
easy  relative  to  computation  of  the  inverse  of  A(x). 

(iii)  Efficiency 

For  the  thinning  algorithm  (as  well  as  the  algorithm  based  on  conditioning  and 
acceptance-rejection)  efficiency,  as  measured  by  the  number  of  points  deleted,  is  proportional  to 
Mo/Mo  “  lA(x0)  -  A (0) }/{ A*(x0)  -  A*(0)};  this  is  the  ratio  of  the  areas  between  0  and  x0 
under  A(x)  and  A*(x).  Thus,  A*(x)  should  be  as  close  as  possible  to  A(x)  consistent  with 
ease  of  generating  the  nonhomogeneous  Poisson  process  { jV*(jc) :jc  ^  0). 

(iv)  An  example:  fixed  cycle  plus  trend 

To  illustrate  the  applicability  of  the  thinning  algorithm,  consider  its  use  in  conjunction 
with  the  algorithms  given  by  [13]  and  [15]  for  log-linear  and  log-quadratic  rate  functions. 
Assume  that  it  is  necessary  to  simulate  a  nonhomogeneous  Poisson  process  whose  rate  function 
increases  quadratically  with  time  but  also  has  a  fixed-period  cycle,  e.g., 

\(x)  =  exp(a0  +  axx  4-  ar2x2  +  K  sinfaiQX  +  0 )}. 

0  <  x  «£  x0;  K  >  0;  0  <  9  ^  2tt;  <u0  >  0. 

This  is  the  model  found  by  Lewis  [12]  for  arrivals  at  an  intensive  care  unit,  where  there  is  a 
strong  time-of-day  effect.  Thus  if  ca0  —  2rr/T0,  then  the  period  To  *  1  day.  Computation  of 
A_,(  )  is  difficult.  To  determine  A*(x),  note  that 

A(x)  <  A*(x)  -  exp{a0  +  K  +  0)X  +  a2x2), 

and  therefore 

A(x)/A*(x)  -  explAfl  -  sin(too*  +  #))]■ 

Thus  in  step  3  of  Algorithm  1,  U,  is  compared  to  exp[AT (1  —  sin(to0Af,*+  ®))J.  Equivalently,  if 
unit  exponential  variates  E,  are  available,  it  is  faster  to  compare  E,  to  K (1  —  sin(w0A7  +  ®)K 
accepting  AT? if  E,  >  K{  1  -  sin(w0Afr+  9)). 

The  main  computational  expense  here  is  generation  of  the  E,  and  computation  of  the  sine 
function,  both  n*  times.  The  expense  involved  in  computation  of  the  sine  function  can  be 
reduced  by  noting  that  the  point  AT*  is  always  accepted  if  E,  is  greater  than  IK.  This  will  be  a 
great  saving  if  the  cyclic  effect  is  minor  ( K  small).  The  number  of  E,  generated  can  be  reduced 
by  noting  that  if,  in  one  step  of  the  algorithm,  E,  is  observed  to  be  greater  than  S,  then 
£•—£,-  8  can  be  used  as  an  (independent)  unit  exponential  variate  in  the  next  step.  The 
above  procedure  can  be  extended  to  the  case  of  a  trend  with  two  fixed-period  cycles,  e.g.,  a 
time-of-day  and  a  time-of-week  effect. 
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4.  SIMULATION  OF  TWO-DIMENSIONAL  HOMOGNEOUS  POISSON  PROCESSES 

The  two-dimensional  homogeneous  Poisson  process  (of  rate  A  >  0)  is  defined  by  the  pro¬ 
perties  that  the  numbers  of  points  in  any  finite  set  of  nonoverlapping  regions  having  areas  in 
the  usual  geometric  sense  are  mutually  independent,  and  that  the  number  of  points  in  any 
region  of  area  A  has  a  Poisson  distribution  with  mean  see,  e  g.  (11),  pp.  31-32.  Note  that 
the  number  of  points  in  a  region  R  depends  on  its  area,  but  not  on  its  shape  or  location.  The 
homogeneous  Poisson  process  arises  as  a  limiting  two-dimensional  point  process  with  respect  to 
a  number  of  limiting  operations;  cf.,  [8]  and  [91 .  Properties  of  the  process  are  given  by  [16]. 
Applications  of  the  two-dimensional  homogeneous  Poisson  process  to  problems  in  ecology  and 
forestry  have  been  discussed  by  Thompson  (21)  and  Holgate  (10).  The  model  also  arises  in 
connection  with  naval  search  and  detection  problems. 

In  considering  the  two-dimensional  homogeneous  Poisson  process,  projection  properties 
of  the  process  depend  quite  critically  on  the  geometry  of  the  regions  considered.  These  projec¬ 
tion  properties  are  simple  for  rectangular  and  circular  regions,  and  make  simulation  of  the 
homogeneous  process  quite  easy.  We  consider  these  two  cases  separately. 

(i)  Homogeneous  Poisson  processes  in  a  rectangle 

The  following  two  theorems  form  the  basis  for  simulation  of  the  two-dimensional  homo¬ 
geneous  Poisson  process  in  a  rectangle. 

THEOREM  2:  Consider  a  two-dimensional  homogeneous  Poisson  process  of  rate  X,  so 
that  the  number  of  points  in  a  fixed  rectangle  R  —  ((x,.y):  0  <  x  <  x0,  0  <  y  <  yo)  has  a 

Poisson  distribution  with  parameter  XxoVo-  If  (Afj ,  Y\),  (A’j,  Y2) . (XN,  Fv)  denote  the 

position  of  the  points  of  the  process  in  R,  labelled  so  that  X\  <  X2  <  ...  <  Xs,  then 

X\,  X2 . XN  form  a  one-dimensional  homogeneous  Poisson  process  on  0  <  x  <  x0  of  rate 

Xy0.  If  the  points  are  relabelled  (X{ ,  ),  (JITj ,  Y2) . (X'N,Y'N)  so  that 

Y[  <  Y2  <  ...  <  Y'n ,  then  Y[,  Y2,  . . .  ,  Y'N  form  a  one-dimensional  homogeneous  Poisson 
process  on  0  <  y  <  y0  of  rate  Xx0. 

PROOF:  The  number  of  points  in  an  interval  on  the  x-axis,  say  (a,b\  is  the  number  of 
points  in  the  rectangle  bounded  by  the  lines  x  -  a,  x  -  b,  y  -  0,  and  y  -  y0.  This  number  is 
therefore  independent  of  the  number  of  points  in  any  similar  nonoverlapping  rectangle  bounded 
on  the  x-axis  by  x  —  a',  x  —  b\  i.e.,  the  number  of  points  in  the  interval  (a',b'].  This  estab¬ 
lishes  the  independent  increment  property  for  a  one-dimenSional  Poisson  process.  The  Poisson 
distribution  of  the  number  of  points  in  (a,6)  follows  from  the  fact  that  it  is  equal  to  the  number 
of  points  in  the  rectangle  bounded  by  x  -  a,  x  -.6,  y  —  0,  and  y  -  _y0<  an<I  tfle  latter  has  a 
Poisson  distribution  wih  parameter  ky^fb-a).  An  analogous  argument  shows  that  the  process 
formed  on  the  y-axis  by  Y{,  Yi,  ,  Y'N  is  Poisson. 

Conditional  properties  of  the  Poisson  process  in  a  rectangle  are  established  next.  The 
important  thing  to  note  is  that  while  the  processes  obtained  by  projection  of  the  points  onto  the 
x  and  y  axes  are  not  independent,  there  is  a  type  of  conditional  independence  which  makes  it 
easy  to  simulate  the  two-dimensional  process. 

THEOREM  3:  Assume  that  a  two-dimensional  homogeneous  Poisson  process  of  rate  X  is 
observed  in  a  fixed  rectangle  R  =  {(x,y):  0  <  x  <x0,  0  <  y  <  y0K  s°  that  the  number  of 
points  in  R,  N(R),  has  a  Poisson  distribution  with  parameter  Xx0y0.  If  N(R)  -  n  >  0  and  if 
(3ft,K|),  (X2  ,Y2),  ....  (X„,Y„)  denote  the  points,  labelled  so  that  X\  <  X2  <  . . .  <  Xn,  then 
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conditional  on  having  observed  n  points  in  R,  the  Xt.  X2,  ,  X„  are  uniform  order  statistics 

on  0  <  x  <  x0,  and  T|.  Y2 . Y„  are  independent  and  uniformly  distributed  on 

0  <  y  <  y0,  independent  of  the  X,. 

PROOF:  If  there  are  N  points  in  the  rectangle,  form  N  vertical  strips,  from  0  to  j'o  and 
from  X,  to  X,  +  dx„  such  that  each  strip  contains  only  one  of  the  N  points.  The  position  of  Y, 
on  the  vertical  line  through  X,  is  that  of  an  event  in  a  Poisson  process  of  rate  Xdx,,  given  that 
only  one  event  occurs.  But  this  means  that  Y,  is  uniformly  distributed  between  0  and  y0. 
Moreover,  this  is  true  irrespective  of  where  X,  occurs;  therefore  Y,  is  independent  of  X, .  Also, 
occurrences  in  all  N  strips  are  independent,  and  therefore  K,  is  independent  of  the  other  Y,  and 
X,  positions  j  ^  i.  Thus,  the  Y,  are  a  random  sample  of  size  A  from  a  uniform  (O.^o)  distribu¬ 
tion,  independent  of  the  X,.  Now  condition  on  N  —  n  (>  0);  since  by  Theorem  2  the  X,  form 
a  Poisson  process  they  are,  by  well-known  results,  order  statistics  from  a  uniform  (0,x0)  sample 
and  are  independent  of  the  fixed  size  Y,  population;  thus  the  pairs  (X,,  Y)  are  mutually 
independent. 

COROLLARY:  Denote  the  Poisson  points  by  (Yt,  Ki),  {X2,  F2) . where  the  index 

does  not  necessarily  denote  an  ordering  on  either  axis.  Conditionally,  the  pairs 
(Y|.T|).  ....  (Yy.y.v)  are  independent  random  variables.  Furthermore,  for  each  pair,  X,  is 
distributed  uniformly  between  0  and  x0,  independently  of  Yn  which  is  uniformly  distributed 
between  0  and  yQ. 

From  the  two  theorems,  the  following  simulation  procedure  is  obtained. 

ALGORITHM  2:  Two-dimensional  homogeneous  Poisson  process  in  a  rectangle. 


1.  Generate  points  in  the  one-dimensional  homogeneous  Poisson  process  of  rate  Ky0  on 
(0,  x0].  If  the  number  of  points  generated,  n ,  is  such  that  n  =  0,  exit;  there  are  no 
points  in  the  rectangle. 

2.  Denote  the  points  generated  by  Y|  <  X2  <  . . .  <  X„. 

3.  Generate  Y\,  Y2 . Y„  as  independent,  uniformly  distributed  random  numbers  on 

(O^ol 

4.  Return  (Y|,T|),  (Y2,  T2) . (Xn,Y„)  as  the  coordinates  of  the  two-dimensional  homo¬ 

geneous  Poisson  process  in  the  rectangle,  and  n. 

Note  that  generation  of  the  points  X\,  X2,  ,  XN  in  Steps  1  and  2  can  be  accomplished  by 

cumulating  exponential  (X^0)  random  numbers.  Alternatively,  after  generating  a  Poisson  ran¬ 
dom  number  iV-«  (with  parameter  Xxq^q),  n  independent,  uniformly  distributed  random 
numbers  on  (0,x0l  can  be  ordered;  see  {13],  p.  502. 

Another  algorithm  for  generation  of  the  two-dimensional  Poisson  process  in  a  rectangle 
can  be  based  on  the  Corollary  to  Theorem  3. 

(ii)  Homogeneous  Poisson  processes  in  a  circle 

The  following  two  theorems  form  the  basis  for  simulation  of  the  two-dimensional  homo¬ 
geneous  Poisson  process  in  a  fixed  circle  of  radius  r0. 
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Fix  the  origin  and  initial  line  of  polar  coordinates  r  and  0  so  that  the  origin  is  the  center 
of  the  circle  and  the  initial  line  is  horizontal.  We  consider  the  projection  of  the  points  ( /?, ,  0,), 
of  the  Poisson  process  circularly  onto  the  r-axis  (/?,)  and  radially  onto  the  circumferential  0-axis 
(0,).  The  number  of  points  projected  onto  the  r-axis  in  the  interval  (0,r),  where  r  <  r0,  is  the 
number  of  points  in  the  circle  of  radius  rand  area  j rr2;  thus  the  number  of  points  in  (0,r)  has  a 
Poisson  distribution  with  parameter  Knr2.  Consequently,  if  the  projection  process  on  the  r-axis 
is  a  Poisson  process,  it  must  have  integrated  rate  function  A(r)  -  Xirr2,  with  A (0)  =  0. 

Similarly,  the  number  of  points  on  the  circumferential  arc  of  the  fixed  circle  (radius  r0) 
from  0  to  0  is  the  number  of  points  in  the  sector  of  the  circle  defined  by  radial  lines  at  angles  0 
and  0;  thus  the  number  of  points  on  the  arc  from  0  to  0  has  a  Poisson  distribution  with  param- 

g 

eter  Xirro  x  - —  -  0Xro/2.  Accordingly,  if  the  projection  process  on  the  0-axis  is  a  Poisson 
2ir 

process,  it  must  have  integrated  rate  function  A (0)  -  0Xro2/ 2,  with  A (0)  =  0. 

We  now  assert  that  the  projection  processes  are  in  fact  Poisson  processes.  Since  proofs  of 
these  theorems  are  directly  analogous  to  the  proofs  of  Theorems  2  and  3,  they  are  omitted. 

THEOREM  4:  Consider  a  two-dimensional  homogeneous  Poisson  process  of  rate  X  so 
that  the  number  N  of  points  in  a  fixed  circular  area  C  of  radius  r0  and  area  irr o  has  a  Poisson 
distribution  with  parameter  Xrrro.  If  (R|,0,),  (R2,0  2),  ...  ,  (R\.0,v)  denote  the  points  of  the 
process  in  C,  labelled  so  that  R,  <  R2  <  ...  <  RN,  then  R  1(  R2 . Rv  form  a  one¬ 

dimensional  nonhomogeneous  Poisson  process  on  0  ^  r  <  r0  with  rate  function  X(r)  —  2nkr. 

If  the  points  are  relabelled  (Rj,0[),  ( R2,92 ) . (R^,0y)  so  that  0J  <  0j  <  . . .  <  0’v,  then 

0{,  0j,  ,  0'h  form  a  one-dimensionai  homogeneous  Poisson  process  on  0  <  0  <  2jt  of  rate 

W/2. 

THEOREM  5:  Assume  that  a  two-dimensional  Poisson  process  of  rate  X  is  observed  in  a 
fixed  circular  area  C  of  radius  r0  so  that  the  number  of  points  in  C,  /V(C),  has  a  Poisson  distri¬ 
bution  with  parameter  X7rr02.  If  N(C)  -  n  >  0  and  if  (R,,0|),  (R2,02) . (R„,0„)  with 

Ri  <  R2  <  ...  <  R„  denote  the  points,  then  conditional  on  having  observed  n  points  in  C, 

the  R,,  R2 . R„  are  order  statistics  from  the  density  /(r)  =  2r/r02  concentrated  on 

0  <  r  <  r0,  and  0,.  02,  ,  0„  are  independent  and  uniformly  distributed  on  0  <  0  <  2  it, 

independent  of  the  R,.  These  theorems  lead  to  the  following  simulation  procedure. 

ALGORITHM  3:  Two-dimensonal  homogeneous  Poisson  process  in  a  circular  area. 

1.  Generate  n  as  a  Poisson  random  number  with  parameter  knr^.  If  n  =  0,  exit;  there  are 
no  points  in  C. 

2.  Generate  n  independent  random  numbers  having  density  function  f(r)  =  2 r/r02  and  order 
to  obtain  R,  <  R2  <  .. .  <  R„. 

3.  Generate  0),  02 . 0„  independent,  uniformly  distributed  random  numbers  on  (0,2jt). 

4.  Return  (R|,0,),  (R2.02) . (R„. 0„),  and  n. 

Note  that  the  wedge-shaped  density  2r/r02  can  be  generated  by  scaling  the  maximum  of  two 
independent  uniform  (0,1)  random  numbers. 

Direct  generation  of  homogeneous  Poisson  points  in  non-circular  or  non-rectangular 
regions  is  difficult.  The  processes  obtained  by  projection  of  the  points  on  the  two  axes  are 
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nonhomogeneous  Poisson  processes  with  complex  rale  functions  determined  by  the  geometry 
of  the  region.  However,  the  conditional  independence  which  is  found  in  circular  and  rectangu¬ 
lar  regions  (Theorems  3  and  5)  for  the  processes  on  the  two  axes  is  not  present.  In  particular, 

given  that  there  are  n  points  . (X„,Y„)  in  a  non-rectangular  region,  the  pairs 

( X,,Y ,)  are  mutually  independent,  but  X,  is  in  general  not  independent  of  Y,,  i  -  1,  ....  n. 
Therefore,  it  is  simpler  to  enclose  the  region  in  either  a  circle  or  a  rectangle,  generate  a  homo¬ 
geneous  Poisson  process  in  the  enlarged  area,  and  subsequently  exclude  points  outside  of  the 
given  region. 

5.  SIMULATION  OF  TWO-DIMENSIONAL  NONHOMOGENEOUS 

POISSON  PROCESSES 

The  two-dimensional  nonhomogeneous  Poisson  process  { jV (jv,^ ) :jc  ^  0,  y  >  0)  is 
specified  by  a  positive  rate  function  k(x,y )  which,  for  simplicity,  is  assumed  here  to  be  continu¬ 
ous.  Then  the  process  has  the  characteristic  properties  that  the  numbers  of  points  in  any  finite 
set  of  nonoverlapping  regions  having  areas  in  the  usual  geometric  sense  are  mutually  indepen¬ 
dent,  and  that  the  number  of  points  in  any  such  region  R  has  a  Poisson  distribution  with  mean 
A {R)\  here  A (R)  denotes  the  integral  of  X(x,.y)  over  /?,  i.e.,  over  the  entire  area  of  R. 

Applications  of  the  two-dimensional  nonhomogeneous  Poisson  process  include  problems 
in  forestry  and  naval  search  and  detection.  The  use  of  the  process  as  a  model  for  the  pattern  of 
access  to  the  storage  subsystem  of  a  computer  system  will  be  reported  elsewhere.  Detection 
and  statistical  analysis  of  trends  in  the  two-dimensional  nonhomogeneous  Poisson  process  is 
discussed  by  Rantschler  [18], 

Theorem  1  dealing  with  thinning  of  one-dimensional  nonhomogeneous  Poisson  processes 
generalizes  to  two-dimensional  nonhomogeneous  Poisson  processes.  Thus,  suppose  that 
X(x,.y)  <  \*(x,y)  in  a  fixed  rectangular  region  of  the  plane.  If  a  nonhomogeneous  Poisson 
process  with  rate  function  X*(x,y)  is  thinned  according  to  Xfx-.yl/X'Ix.y)  (i.e.,  each  point 
(X,.Y,)  is  deleted  independently  if  a  uniform  (0,1)  random  number  U,  is  greater  than 
X(.Y,,  Y,)/k  *(X,,  Y,)),  the  result  is  a  nonhomogeneous  Poisson  process  with  rate  function  X(x,>>). 
The  proof  is  a  direct  analogue  of  the  proof  for  the  one-dimensional  case. 

The  nonhomogeneous  Poisson  process  with  rate  function  X(x,.y)  in  an  arbitrary  but  fixed 
region  R  can  be  generated  by  enclosing  the  region  R  either  in  a  rectangle  or  a  circle,  and  apply¬ 
ing  Algorithm  2  or  Algorithm  3.  The  following  procedure  assumes  that  the  region  R  has  been 
enclosed  in  a  rectangle  R  *,  and  that  X*  =  max  {X(x,>>):x,>'  6  /?)  has  been  determined,  here  the 
bounding  process  is  homogeneous  with  rate  X*in  the  rectangle  R'. 

ALGORITHM  4:  Two-dimensional  nonhomogeneous  Poisson  process. 


1.  Using  Algorithm  2,  generate  points  in  the  homogeneous  Poisson  process  of  rate  X*in  the 

rectangle  R*.  If  the  number  of  points,  n*,  is  such  that  n*  =  0,  exit;  there  are  no  points  in 

the  nonhomogeneous  Poisson  process. 

2.  From  the  n*  points  generated  in  1,  delete  the  points  that  are  not  in  R ,  and  denote  the 

remaining  points  by  (Aff.Kf),  (A’J.TJ) . (X*m.Y*m)  with  Xf  <  X$  <  ...  <  JF*.  Set  i 

=  1  and  k  =*  0. 


3.  Generate  U  uniformly  distributed  between  0  and  1.  If  U,  <  \(X*,Y?)/\  \  set  k  -  Ar+1, 
Xk  -  A?  and  Yk  =  Y*. 
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4.  Set  /  equal  to  /+1.  If  /  <  m”,  go  to  3. 

5.  Return  ( A'i  T|).  (X2,  K2),  ....  (X„,  Y„),  where  n  -  k ,  and  //. 

It  is  not  necessary  that  the  bounding  process  have  a  constant  rate  A*  Theorems  2  and  4 
can  be  generalized  to  certain  cases  where  the  process  is  nonhomogeneous  (cf.,  [3]),  for 
instance  ACx.y)  =  p(x)  Thus,  a  tighter  bounding  process  which  is  nonhomogeneous  may 

possibly  be  obtained.  It  is  not  simple  to  see  how  much  efficiency  could  be  gained  by  doing  this, 
as  opposed  to  using  a  two-dimensional  homogeneous  Poisson  process  for  the  bounding  process. 
Again,  as  in  the  one-dimensional  case,  savings  in  computing  k(x,y)  can  be  obtained  by  comput¬ 
ing  its  minimum  beforehand,  and  the  U's  can  be  reused  by  scaling 

6.  COMPARISONS  AND  CONCLUDING  REMARKS 

The  method  of  thinning  presented  in  this  paper  for  simulating  one-dimensional  and  two- 
dimensional  nonhomogeneous  Poisson  processes  with  given  rate  function  can  be  carried  out  in 
a  computationally  simple  way  by  using  a  bounding  process  which  is  homogeneous  with  a  rate 
function  equal  to  the  maximum  value  of  the  given  rate  funciton.  No  numerical  integration, 
ordering,  or  generation  of  Poisson  variates  is  required,  only  the  ability  to  evaluate  the  given 
rate  function.  The  thinning  algorithm  appears  to  le  particularly  attractive  in  the  two- 
dimensional  case  where  there  seem  to  be  no  competing  algorithms. 

The  thinning  algorithm  can  also  be  implemented  more  efficiently  at  the  cost  of  program¬ 
ming  complexity  and  by  using  a  nonhomogeneous  bounding  process.  In  particular  the  method 
can  be  used  in  conjunction  with  the  special  algorithms  given  by  [13]  and  [15]. 

It  is  also  possible  to  extend  the  method  of  thinning  to  simulation  of  doubly  stochastic  or 
conditioned  Poisson  processes.  This  will  be  discussed  elsewhere. 
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ABSTRACT 

This  paper  characterizes  the  structure  of  optimal  strategies  for  a  replace¬ 
ment  problem  for  two  special  cases  of  observation  quality.  It  is  shown  that 
when  the  stale  of  the  system  is  either  completely  observed  or  completely  unob¬ 
served  at  every  decision  epoch  by  the  controller,  reasonable  assumptions  are 
sufficient  for  the  existence  of  optimal  replacement  strategies  composed  of  poli¬ 
cies  having  a  generalized,  control-limit  form.  These  structural  results  are  of 
particular  interest  since  the  optimal  cost  functions  for  the  two  special  cases 
represent  bounds  on  the  optimal  cost  function  for  the  general  partially  observed 
case,  significant  computational  simplification  can  result  for  the  two  special  cases 
due  to  their  optimal  strategy  structure,  and  optimal  strategics  possessing  a 
control-limit  structure  do  not  necessarily  exist  for  the  general  partially  observed 
case. 


1.  INTRODUCTION 

In  this  paper  the  structural  properties  of  the  optimal  replacement  strategy  for  two  special 
cases  of  a  general  replacement  problem  are  characterized.  The  system  is  modeled  by  a  Markov 
process.  The  controller  can  either  replace  or  do  nothing  at  each  decision  epoch.  The  system  is 
assumed  partially  observed;  that  is,  only  the  realization  of  a  stochastic  process,  probabilistically 
related  to  the  system’s  state  process,  is  made  available  to  the  controller  just  prior  to  decision 
epochs.  Thus,  the  replacement  problem  is  modeled  by  the  partially  observed  Markov  decision 
process  [1,7,8]. 

The  two  special  cases  considered  are  the  completely  observed  case,  where  the  controller 
knows  the  system's  state  exactly,  and  the  completely  unobserved  case,  where  the  controller 
receives  no  information  regarding  the  state  process  through  the  observation  process.  For  both 
cases  it  is  shown  that  a  generalized  notion  of  the  increasing  failure  rate  [3]  and  reasonable 
assumptions  on  the  cost  structure  are  sufficient  for  the  existence  of  optimal  strategies  having  a 
generalized,  control-limit  structure. 

Interest  in  these  special  cases  is  two-fold.  First,  they  represent  valuable  models  of  system 
replacement.  Second,  the  optimal  expected  cost  functions  for  the  completely  observed  and  the 
completely  unobserved  cases  represent  lower  and  upper  bounds,  respectively,  on  the  optimal 
expected  cost  function  for  the  general  partially  observed  problem  [1].  This  second  result  is 
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particularly  interesting  in  light  of  the  following  facts.  First,  the  optimal  cost  and  strategy  for 
the  general  partially  observed  problem  are  not  guaranteed  to  have  a  monotone  structure,  a ,  has 
been  shown  in  111)  by  counterexample.  Second,  the  computational  requirements  for  the  gen¬ 
eral  case  can  be  substantial  [6,8].  Third,  considerable  computational  reduction  may  be  induced 
by  the  optimal  cost  and  strategy  structure  for  the  two  cases  of  interest. 

Section  2  presents  the  general,  partially  observed,  Markov  decision  model  of  system 
replacement.  The  finite-horizon,  discounted  cost,  and  average  cost  criteria  are  considered. 
Applying  results  due  to  Porteus  (4),  the  existence  of  optimal  strategies  having  control-limit 
structures  is  proved  in  Section  3  for  the  two  special  cases.  Emphasis  is  placed  on  the  less  well- 
known,  completely  unobserved  problem.  Computational  aspects  of  these  two  cases  are  briefly 
discussed. 

2,  PROBLEM  FORMULATION  AND  PRELIMINARIES  FOR  THE  GENERAL  CASE 

Let  the  stochastic  process  )s(/),  i  =0,1,  ...  ],  having  finite  stale  space  S,  model  a  sys¬ 
tem  subject  to  Markov  deterioration.  Let  <  be  a  partial  order  on  S,  describing  the  relative 
deterioration  of  the  system,  i.e.  if  /  <  /'  then  /'  is  a  less  desirable  system  state  than  /.  We 
assume  that  S  is  only  partially  ordered  to  allow  (s(r),  r  =0,1,  ...)  to  be  a  vector  process 
which  could  serve  as  a  model  of  a  multi-component  system  or  a  system  subject  to  semi-Markov 
deterioration.  Let  0  be  a  minimal  element  in  S;  i.e.,  0  <  /  for  all  /€S.  The  state  0  therefore 
corresponds  to  the  "best"  or  "newly  replaced"  state.  Assume  the  a  priori  probabilities 

x,  =  1 1  are  given,  where  p ,°  =  /Ms(0)  =  /]. 


The  controller  observes  the  state  of  the  system  at  each  time  r  =  1,2 .  The  observa¬ 

tion  may  be  noise-corrupted  and  is  assumed  to  be  the  realization  of  a  random  variable  z(r)  at 
time  r.  The  resulting  process  (z(r),  t  =  1,2,  ...)  is  called  the  observation  process,  which  is 
assumed  to  have  a  finite  state  space. 

A  decision  is  made  at  each  time  /  =  0, 1 . n  —  \  to  replace  the  system  or  to  keep  it 

until  the  next  decision  epoch,  where  n  <  °°  represents  the  terminal  time  of  the  problem.  The 
decision  to  replace  is  equivalent  to  guaranteeing  that  the  state  of  the  system  at  the  next  decision 
epoch  will  be  0.  Let  u(t)  6 D  =  (0,1)  represent  the  decision  made  at  time  r,  where  0  =  do 
nothing  and  1=  replace.  It  is  assumed  that  the  controller  bases  all  decisions  on  all  former  deci¬ 
sions  made  and  all  past  and  present  observations  of  the  system;  hence, 

(1)  «(/)  -  y,[w(0) . w (/  -  1),  z(l) . z(f)]. 

The  processes  (s(r),  /  =  0, 1,  ...  },  {z (z) ,  t  =  1,2,  . . . },  and  {«(/),  z  =0,1,  . . . )  are 
all  related  by  the  conditional  probabilities  p „  ( y )  =  /’[s (z  +  1)  =  j |  sU)  =  /,  t/(f)  =  j]  and 
<7, a  O’)  =  F(z(t  +  1)  =  k  |  s(z  +  1)  =  j,  u(t)  =  >>],  where  pu  =  p„(0)  and  />„(  1)  =  1  j  =  0. 

Let  r[s(/),  m (z) ]  be  the  cost  accrued  at  time  0  ^  t  <  n.  Additionally,  when  the  problem 
horizon  is  finite,  assume  a  terminal  cost  r0[s(«)]  is  accrued  at  the  terminal  time.  All  costs  are 
assumed  to  be  nonnegative. 

The  finite  horizon  problem  is  to  select  a  sequence  of  policies  y,,  z  —0,1,  ...  n  -  1, 
satisfying  (1)  which  minimizes  the  criterion  £{L,"_n'  P'  r[s(r),  «(z)]  +  /3''r0[s ( zz )]  |/>n},  where 


p°=  {/>,"}  en  =  ^  0,£ 

/<=  s 
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/3 €  [0. 1 )  is  the  discount  factor.  Similarly,  the  discounted  and  average  cost  problems  are  to 
select  a  sequence  of  policies  y„  r  =0,1,  ...  satisfying  (1)  which  respectively  minimize 

£(I"o/3V[i(r),  m(/)1  |  />"!  and  lim  sup  — —  £{I,10  r[s(r),  w(()]  |  />0},  where  for  the 

//— oo  H  4"  1 

discounted  cost  case  fi  <  I . 

It  has  been  shown  that  the  partially  observed  Markov  decision  problem  can  be  reformu¬ 
lated  as  the  following  completely  observed  Markov  decision  problem  [1,7,8].  Let  |x(r), 
(=0,1,  . . .  |  and  {8(f),  (=0,1,  . . . )  be  the  (completely  observed)  state  and  control  processes 
related  by  the  stochastic  difference  equation  x(r  +  l)  =  K  (z(/-H),  x(/),  5(/)],  x(0)  p°, 

where  A:S  x  ft  x  D  — >  ft  has  yth  component  k,(,k,x,y)  =  qlk(.v)  L,pll(y)x,/cr(k,x,y)  = 
P(s(t  + 1)=  j  j  x(()  =  x,  z (f  4-  1)  =  k ,  u(t)  =  y)  and  where  <r(k,x,y)  =  Z,  Z,  qlk  (y)p„  (y)x, 
=  P(z(i  +  1)  =  k  |  x(i)  —  x,  «(f)=y).  The  vector  x(r)  can  be  thought  of  as  the  probability 
density  of  s(t)  on  S  conditioned  on  all  past  decisions  and  the  past  and  present  sample  path  of 
the  observation  process.  Further  interpretations  of  these  terms  can  be  found  in  [8,10].  It  is 
sufficient  [1,7]  to  consider  policies  of  the  form 

(2)  8(/)  =  y,  [*(/)]. 

The  criterion  for  the  equivalent,  finite  horizon  problem  is  E{ I,'Lo'  x(t)r(y)  +  x  («)r0  |  x(0)}, 
where  r(y)  =  {z(/,y)j,  r0  -  [rn(/)},  and  xr  =  I ,x,r,.  The  discounted  and  average  cost  criteria 
are  modified  appropriately,  the  equivalent  problem  is  to  select  a  sequence  of  policies  satisfying 
(2)  which  minimizes  the  desired  criterion. 

The  replacement  problem  is  now  described  in  the  context  of  [4],  Define  /i(x,y,  v)  =  xr 
O’)  +  fi  1/  <y ( k.x.y )  v  [A ( k,x,y ) ] ,  where  vgV  =  { v € /? 11 :  0  <  v(x)  for  all  xj  and  where /3  =  1 

for  the  average  cost  case.  The  scalar  liix.y,  v)  can  be  interpreted  as  the  expected  cost  to  be 

accrued  from  time  (  until  the  terminal  time,  given  that  x(r)  =  x,  u (f)  =  y,  and  if 

x(t  +  1)  =  k(k,x,y ),  then  the  expected  cost  to  be  accrued  from  time  (  +  1  until  the  terminal 

time  is  v[\(k,x,y)].  Let  A  be  the  set  of  all  functions  8  $1— D,  i.e.,  A  =  Dil.  It  is  desired  to 
determine  a  subset  of  A,  designated  as  A*  and  called  the  set  of  structured  policies,  which  will 
always  contain  optimal  policies.  The  following  definitions  are  preliminary  to  the  definition  of 
the  A ‘which  will  be  examined  throughout  the  remainder  of  this  paper. 

DEFINITION  1.  (i)  Let  K  be  the  set  of  all  subsets  of  S  such  that  if  /€£€ K  and  /  <  /', 
then  /'€  K. 

(ii)  Let  the  partial  ordering  <  on  1)  be  defined  as  x  <  x'  if  and  only  if  xlK  ^  x'lK  for 
all  £6K,  where  x/A  =  I ,x,lK(i)  and  where  /*  is  the  indicator  function  of  the  set  K,  i.e., 
/*(')  =  0  if  / 4 K  and  /*•(/')  =  1  if  iiK.  Note  that  this  partial  ordering  is  equivalent  to  stochas¬ 
tic  dominance. 

For  the  case  where  the  controller  is  not  qllowed  completely  informative  on-line  data  of  the 
system’s  state  and  has  only  the  process  {.v ( z ) ,  (=0,1,  . . .  ]  available  on  which  to  base  a  deci¬ 
sion,  it  will  be  shown  that  if  x  <  x’,  then  state  x'  is  not  more  desirable  than  state  x. 

The  restricted  set  of  policies  is  now  defined  and  will  be  shown  in  the  following  section  to 
always  contain  an  optimal  policy  under  reasonable  assumptions.  This  set  generalizes  the  usual 
notion  [2]  of  (and  will  also  be  referred  to  as)  the  set  of  all  control-limit  policies. 

DEFINITION  2.  A*  =  |8eA:x  <  x’  implies  8(x)  ^  8(x')}. 


•  . . 


_ _ _ 
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It  will  also  be  shown  that  control-limit  policies  will  induce  structural  properties  of  their 
associated  expected  cost  functions.  The  set  of  all  such  cost  functions  is  now  defined. 

DEFINITION  3.  Define  V*  =  (ve  F:v  is  concave,  and  .v  <  v  implies  v(.v)  <v(jr  )). 

We  complete  this  section  with  the  following  definitions.  The  optimal  expected  cost  to  be 
accrued  between  lime  i  and  the  terminal  time  n  is  =  inf  (Hk  x  ...  x  Hh  u0),  where 

TT  '  " 

i/„(.v)  =  xr0,  tt  =  (8n . 8„_,),  and  (f/sv](.v)  =  li[x,  8(.v),  v].  The  optimal  discounted  cost 

accrued  over  the  infinite  horizon  is  /  =  inf  lim  (//s  x  ...  x  Hi  u0). 

n  n—o o  i  "  1 

3.  STRUCTURE  OF  OPTIMAL  STRATEGIES  AND  COST  FUNCTIONS  FOR  THE 
COMPLETELY  OBSERVED  AND  COMPLETELY  UNOBSERVED  CASES 

In  this  section  two  special  cases  of  the  general  replacement  problem  described  above  are 
considered,  the  completely  observed  case  (where  qJk(y)  is  the  Kronecker  delta  for  all  >)  and 
the  completely  unobserved  case  (where  qik(y)  is  independent  of  j  for  all  k  and  .y,  i.e., 
(>■ )  =  ^(y)).  The  completely  observed  case  is  a  direct  generalization  of  results  in  (3]  and 
has  been  examined  under  slightly  different  assumptions  in  (91.  The  completely  unobserved 
case  is  a  generalization  of  a  slightly  different  version  of  Example  2  [5,  p.  130).  It  will  be  shown 
that  for  both  cases  an  optimal  strategy  can  be  found  which  is  composed  of  policies  in  A*,  thus 
inducing  optimal  expected  cost  functions  which  are  members  of  V*. 

Two  assumptions  are  now  stated,  following  a  preliminary  definition,  which  will  be  shown 
to  be  sufficient  for  the  existence  of  optimal  strategies  composed  of  policies  in  A* for  both  spe¬ 
cial  cases. 

DEFINITION  4.  Let  F  =  \£€Rs:i  <  i'  implies  (0)  <  £(#’)},  the  set  of  all  real-valued 
functions  on  S  which  are  increasing  with  respect  to  the  partial  ordering  <. 

ASSUMPTION  I.  The  cost  functions  rU.y),  for  all  y€£>,  r0(  ),  and  /•(-,())  -  r ( • ,  1 )  are 
members  of  F. 

ASSUMPTION  2.  PIK£ F  for  all  A€K,  where  the  /  th  element  (/ € S)  of  PIK  is  I)6S 
P./IkO)- 

Assumption  1  states  that  operating  and  replacement  costs  and  their  difference  increase  as 
a  function  of  system  state  deterioration;  similarly,  terminal  cost  (for  the  finite  horizon  problem) 
increases  as  a  function  of  system  state  deterioration.  Assumption  2  is  a  generalization  of  the 
increasing  failure  rate  assumption.  Both  of  these  assumptions  are  direct  generalizations  of 
those  made  by  Derman  in  (3)  for  the  scalar,  completely  observed  case. 

Thf.  Completely  Unobserved  Case 

The  case  where  the  controller  receives  no  on-line  data  of  any  value  with  regard  to  the 
actual  state  of  the  system  is  now  examined.  For  this  case  M.v,  0,v)  =  av(0)  +  fix(xP)  and 
h  (x,  1 ,  v)  =  .xrd)  -I-  /3v(en),  where  the  j  th  element  of  xP  is  x,  and  where  e0en  has  1  as 
its  0th  element.  Two  preliminary  results  are  now  presented. 
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LF.MMA  1.  For  x.x'efl,  x  <  x‘  if  and  only  if  x  (,  <  a'41  for  all  £*F. 

PROOF:  Clearly,  /*€F  lor  all  A€K.  Thus,  x|  ^  x'£  for  all  f€F  trivially  implies 

x  <  x\ 

C  onversely,  it  is  easily  shown  that  for  each  £eF  there  exists  a  non-negative  sequence  {aA| 

such  that  f  =  £  (>*  /».  It  then  follows  that  .v  x'  implies  the  equality-inequality  chain 
KtK 

x£  =  I *«*.v/A  <  1K  ukx  lK  =  x'£. 


Q.E.D. 

Lemma  1  and  Assumption  2  imply  the  following  corollary.  (See  also  Theorem  2  lb  in 

[2].) 

COROLLARY  1.  If  x  ■<  x',  then  X(.v,.v) < for  each  .vtD,  where 
k(k,x,v)  =  k(x,y),  is  independent  of  k  for  the  completely  unobserved  case. 

Two  propositions  are  now  presented  which  are  concerned  with  the  structural  properties  of 
the  (unction  h(-,y,x)  for  the  completely  unobserved  case. 

PROPOSITION  1.  If  v<  V\  then  h  (•  ,y,  v)«  F*for  each  yeD. 

PROOF:  This  result  follows  directly  from  the  definitions.  Assumptions  1  and  2,  Lemma 
1  ,  and  Corollary  1. 

PROPOSITION  2.  Assume  v«  V*  and  x  <  x'.  (a)  If  l/(.v,0,v>  -  h(x,  l,v)  >  0,  then 
h(x',0,  v)  —  h(x\  1,  v)  >  0.  (b)  If  h(x',  1,  v)  -  h(x',0,  v)  >  0,  then  h(x,  1,  v)  -  /i(x,0 

v)  >  0. 

PROOF:  This  result  also  follows  directly,  where  we  note 

/;  (x,  0,  v)  -  h(x,  1 .  v)  =  x[r(0)  -  r(l)l  +  /3(v[A(x,0)]  -  v(e0)J.  Q.E.D. 

Two  additional  propositions  are  now  presented  which  will  be  useful  in  the  proofs  of  the 
main  results.  Define  the  operator  A  as  Av  =  inf //sv. 

b 

PROPOSITION  3.  A :  V*  —  V* 

PROOF:  The  finiteness  of  D  implies  the  existence  of  a  86  A  such  that  w(x)  »= 
minMx.y, v)  =  h[x,  8(x),  v].  Since  the  minimum  of  concave  functions  is  concave,  w  is  con- 

D 

cave  by  Proposition  1.  Letting  x  <  x',  the  result  follows  by  the  equality-inequality  chain 
w(x)  <  h(x,  8(x'),  v)  <  h(x\  8(x'),  v>)  =  w(x'). 

Q.E.D. 


PROPOSITION  4.  If  v€  F*,  then  there  exists  a  8€A*such  that  //sv  «  Av. 

PROOF:  Assume  that  8€A  satisfies  f/sv  =  Ax  but  that  8tf  A*.  Let  x  -<  x',  8(x  )  -  0  and 
8(x)  -  1.  By  Proposition  2,  since  // (x.  l,v)  <  //(x.O.v)  it  follows  that  h(x  ,  l.v)  <  /t(x’,0,v) 
and  hence  since  h(x  M.v)  ^  h(x',  0,v),  /t(x',0,v)  -  /t(x',l,v).  Thus,  6  could  have  been 
chosen  so  that  8(x  )  =  1,  and  the  result  holds. 
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Q.E.D. 

The  main  results  for  the  finite  horizon  and  discounted  cost  problem  can  now  be 
presented. 

THEOREM  1.  Consider  the  finite  horizon  problem.  It  follows  that  for  all  /»,  the  optimal 
expected  cost  function  /„€  F*and  that  there  exists  a  sequence  of  control-limit  policies  which  is 
simultaneously  for  all  t  optimal  for  stages  r  to  it. 

PROOF:  This  result  is  an  application  of  Theorem  1  in  [4]  to  the  completely  unobserved 
case,  which  requires  Propositions  3  and  4  for  satisfaction  of  two  of  the  six  hypotheses  specified 
in  [4].  The  remaining  hypotheses  follow  from  the  definitions. 

Q.E.D. 


Theorem  1  guarantees  that  the  optimal  expected  cost  to  be  accrued  over  a  finite  horizon 
of  length  n  is  concave  and  nondecreasing  with  respect  to  <  in  the  a  priori  probability.  Also,  in 
searching  for  an  optimal  strategy,  it  is  sufficient  to  only  examine  strategies  composed  of 
control-limit  policies. 

c 

THEOREM  2.  Consider  the  discounted  cost  problem.  It  follows  that  the  optimal 
expected  discounted  cost  function  / 6  F*and  that  there  exists  an  optimal  stationary  control-limit 
strategy. 

PROOF:  The  above  result  is  a  specialization  of  Theorem  2  and  Corollary  1  and  [4]  to  the 
replacement  problem.  These  results  require  that  nine  hypotheses,  specified  in  [4],  be  satisfied, 
the  first  six  of  which  were  required  for  Theorem  1  above.  If  fl**=fl,  7  =  max  r (/,>•); 

==  (v€  F*:v(x)  <  F/(l  —  /3),  for  all  x€  fl  *),  A  =  1  and  M  =  2r/(l  -  /3),  then  the  remain¬ 
ing  three  hypotheses  are  easily  verifiable  (where  the  notation  in  this  proof  corresponds  to  the 
notation  in  [4].) 

The  above  result  states  that  the  optimal  expected  discounted  cost  is  also  concave  and  non¬ 
decreasing  with  respect  to  <  in  the  a  priori  probability  and  that  there  exists  an  optimal  station¬ 
ary  strategy  generated  by  a  control-limit  policy. 

The  average  cost  case  is  now  examined.  Let  f p  designate  the  optimal  expected  cost  func¬ 
tion  for  the  discounted  cost  case  with  discount  factor  ft.  We  appeal  to  results  in  [5,  pp.  141- 
150]  which  require  fl  *  to  be  countable.  Redefine -fl*  —  [p,ik)\  /€ S,  k  =  0.  1,  .  ..},  where 
P,ik>  =  {/>,/*’}  and  p,(,k 1  =  /MsO  +  k)  —  j  |s(r)  =  /}.  Let  e,€il  have  1  as  its  zth  element.  Note 
that  the  results  of  Theorem  2  hold  for  this  n  *  since  e,€fl  *  for  all  /€ S  and  \(x,y)€  ft  *  for  all 
x  €  fl  *  and  y  €  D. 

THEOREM  3.  Consider  the  average  cost  case.  Then,  there  exists  a  function  /€  V*  which 
is  the  optimal  expected  average  cost  function  and  a  constant  g  such  that  g  +  r(x)  =  min 
|xr(0)  +  /(X(x,0)],  xr(l)  -I-  /(e0) ]  and  there  exists  an  optimal  stationary  control-limit  strategy 
which  causes  the  above  minimum  to  be  attained. 
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PROOF':  Note  that  |/^(.v)  -  .fli(eQ)\  <  rfor  all  p  and  x  since  JP(x)  -  J 0(e u)  >  0  for  all 
x  (clearly,  c0  <  v  for  all  x)  and  fff(x)  <  7  +  P/n(e0)  <  7  +  Theorem  6.18  in  [5,  p. 

146]  is  then  satisfied.  It  follows  from  Theorem  6.18  (ii)  in  |5]  that  /€  V*  since  ./,*€  V*  implies 
/«(  )  —  o)6T*  and  since  V*  is  complete.  The  result  of  Proposition  4  implies  that  the 

minimizing  policy  can  be  chosen  from  A*. 

Q.E.D. 

Thus,  it  is  again  sufficient  to  examine  control-limit  policies  in  search  of  an  optimal  stra¬ 
tegy  and  the  optimal  expected  average  cost  function  is  concave  with  (with  respect  to  11 1  and 
nondecreasing  in  < . 

The  completely  unobserved  problem  is  now  reformulated  into  a  form  compatible  with  the 
computational  algorithm  presented  in  [9],  Let  state  /  for  the  countable  state  reformulated  prob¬ 
lem  be  equivalent  to  state  e0P'  and  assume  that  the  a  priori  probability  p°  =  e0P'  for  some  /. 
The  transition  probabilities  for  the  reformulated  problem  are  then  />’„+,  (0)  =  1  and  />',oU)  =  1. 
Define  r'(r,y)  =»  e0P'r(y)  and  r'0(t)  =  eltP'r0.  Note  that  Assumptions  1  and  2  hold  for  the 
reformulated  problem,  where  elements  A"€K  (analogous  to  K  and  K  in  the  original  problem) 
are  of  the  form  K'  =  {/,/  +  1,  . . . }.  Since  {p„)  is  such  that  />„  =  0  if  s  ^  /,  then  all  of  the 
hypotheses  for  the  use  of  the  algorithm  presented  in  [9]  are  satisfied  and  hence  the  algorithm  is 
applicable  for  the  completely  unobserved  case. 

The  Completely  Observed  Case. 

The  case  where  the  controller  knows  the  present  state  of  the  system  perfectly  at  each  deci¬ 
sion  epoch  is  now  briefly  examined  and  follows  the  outline  (and  leads  to  the  identical  results) 
for  the  completely  unobserved  case. 

For  the  completely  observed  case,  h(x,  0,  v)  =  xr  (0 )  +  fixPv'  and  h\x,  1 ,  v)  = 
.xr(l)  -t-  /3v0,  where  v,  =\(e,).  Note  that  v€  V*  implies  v'€F  and  that  h'(.,y,  v)€F  implies 
h(-,y,\)£\*  due  to  the  linearity  of  li(-,y,v),  where  h'(i,y,\)  =*  h(e,,y,\)  (and  where  the 
notion  of  concavity  for  functions  in  F*is  no  longer  meaningful).  Note  also  that  P/A  € F  for  all 
A  €K  is  equivalent  to  F  for  all  £€F  (which  is  a  generalization  of  the  equivalence  of  Condi¬ 
tions  A  and  B  in  ]3]).  These  results,  and  the  fact  that  /„( x)  =  I ,xj„(e,)  for  all  n  for  the  com¬ 
pletely  observed  case  [1],  can  easily  be  used  to  imply  that  Propositions  1  through  4  and 
Theorems  1  through  3  also  hold  for  the  completely  observed  case,  subject  to  obvious 
modifications  to  fl*  and  (3).  Such  results  are  similar  in  form  (although  not  in  approach)  to 
results  presented  in  [9j.  Furthermore,  if  P  is  such  that  />„  =  0  unless  /  <  ./,  then  the  computa¬ 
tional  algorithm  presented  in  (9]  is  applicable  to  the  completely  observed  case. 

4.  CONCLUSIONS 

This  paper  has  examined  the  structural  properties  of  an  optimal  strategy  and  of  the 
optimal  expected  cost  function  for  two  special  cases  of  a  replacement  problem  subject  to  Mar¬ 
kov  deterioration.  Under  mild  assumptions,  it  has  been  shown  for  these  two  cases  that  there 
exits  optimal  strategies  with  a  generalized  control-limit  structure.  Under  additional  assumptions 
these  structured  strategy  results  have  implied  that  a  recently  developed,  simplified  computa¬ 
tional  approach  is  valid  for  both  cases.  Interest  in  these  two  special  cases  has  resulted  from  the 
fact  that  their  optimal  cost  functions  represent  bounds  on  the  optimal  cost  function  for  the  gen¬ 
eral  case,  which  unfortunately  does  not  necessarily  possess  an  optimal  structured  strategy. 
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ABSTRACT 

The  present  paper  presents  an  algorithm  for  the  exact  determination  of  sur¬ 
vival  distributions  in  crossing  mine  fields  The  model  under  consideration  con¬ 
siders  clusters  of  mines,  scattered  at  random  in  the  field  around  specified  aim 
points.  The  scatter  distributions  of  the  various  clusters  are  assumed  to  be 
known  The  encounter  process  allows  for  a  possible  detection  and  destruction 
of  the  mines,  for  inactivation  of  the  mines  and  for  the  possibility  that  an  ac¬ 
tivated  mine  will  not  destroy  the  object  Recursive  formulae  for  the  determina¬ 
tion  of  the  survival  probabilities  of  each  object  ttankl  in  a  column  of  /(crossing 
at  the  same  path  are  given  The  distribution  of  the  number  of  survivors  out  of 
n  objects  in  a  column  is  also  determined  Numerical  examples  are  given 


1.  INTRODUCTION 

In  ihe  present  paper  we  develop  methods  for  the  exact  numerical  determination  of  the 
survival  probabilities  of  objects  (targets)  crossing  a  field  containing  randomly  scattered  mines 
The  model  under  consideration  refers  to  cases  in  which  the  absorption  points  are  randomly 
scattered  over  the  field  in  one  or  several  clusters.  Each  cluster  is  characterized  by  some  bivari¬ 
ate  distribution  of  the  mines  around  a  center  (aimpoint).  More  specifically  we  consider  clusters 
which  are  distributed  either  as  bivariate  normal  or  uniformly  over  rectangular  domains.  The 
objects  cross  the  field  in  columns  along  predetermined  breaching  paths.  The  movement  of  the 
objects  through  the  field  is  in  a  continuous  manner  (like  that  of  vehicular  or  lank  targets).  The 
mines  may  be  detected  by  the  objects  and  destroyed.  On  the  other  hand,  if  a  mine  is  not 
detected  it  may  or  may  not  be  activated.  If  it  is  not  activated  in  a  specific  encounter  it  may  be 
activated  in  following  encounters.  Defective  mines  (duds)  which  can  never  be  activated  play 
no  significant  role  in  the  determination  of  the  survival  probabilities.  We  have  to  know  the  pro¬ 
portion  of  defective  mines  (duds)  only  in  order  to  determine  correctly  the  distributions  of  the 
anticipated  number  of  active  mines  in  the  various  possible  crossing  paths. 

The  specific  details  of  the  probabilistic  model,  as  related  to  the  structure  of  the  field,  is 
described  in  Section  2. 

There  are  several  papers  in  the  available  literature  [1,2, 3, 4]  which  study  similar  models. 
In  most  of  these  papers  the  results  are  based  on  computer  simulation.  Both  the  location  of 
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mines  and  the  results  of  the  encounters  are  determined  by  Monte  Carlo  methods.  Although 
such  an  approach  can  provide  estimates  of  the  required  survival  probabilities  it  suffers  from  the 
following  deficiencies  (i)  the  amount  of  needed  computer  time  is  excessive;  (ii)  the  estimates 
are  generally  not  accurate  enough;  (iii)  lack  of  theoretical  basis.  In  1966  and  1973  Zacks  and 
Goldfarb  [6]  and  Parsons  (5)  provided  analytical  methods  for  the  derivation  of  formulae  for  the 
exact  determination  of  the  survival  probabilities.  They  treated,  however,  a  model  which  is  too 
restricted.  In  the  present  paper  we  provided  the  formulae  and  the  algorithms  for  the  determi¬ 
nation  of  survival  distribution  exactly.  The  methods  illustrated  in  the  example  of  Section  6  are 
very  efficient,  and  require  on  a  fast  computer  (like  the  UNIVAC  1108)  only  a  few  seconds  for 
the  exact  numerical  solution.  Fortran  programs,  according  to  which  the  numerical  results  have 
been  computed,  are  available  and  can  be  obtained  upon  request.  In  the  following  theoretical 
development  a  mine  is  called  an  "absorption-point"  and  the  object  is  called  a  "particle."  This 
allows  application  of  the  theory  to  more  general  areas. 

2.  STRUCTURAL  AND  PROBABILITY  MODEL  OF  FIELDS 

In  the  present  section  we  provide  specific  models  (sets  of  assumptions)  concerning  the 
structure  of  the  absorption  field;  the  scatter  distributions  of  the  absorption  points;  and  the 
crossing  procedures. 

A.  The  field  structure 

We  assume  that  the  absorption  field  is  rectangular  of  length  L  and  width  W.  We  fix  the 
origin  of  the  coordinates  system  at  the  center  of  the  field.  Crossing  paths  are  along  straight 
lines  parallel  to  the  y-axis,  of  width  DL.  The  center  of  the  crossing  path  is  at  a  point  (#,0). 
The  point  ( fl,  -H72)  is  called  the  breach-point. 

The  absorption  points  are  scattered  over  the  field  at  random,  in  clusters  of  A  points  distri¬ 
buted  according  to  specified  bivariate  distributions  centered  at  given  aimpoints.  Let  k  be  the 

number  of  clusters  in  the  field.  The  coordinates  of  the  aintpoints  are  (£(l>,  V'1)-  '  =  1 . k. 

In  some  applications  the  aimpoints  are  located  along  straights  lines  called  aimpoint  rows.  Let  r 

be  the  number  of  aimpoint  rows.  There  are  m,  aimpoints  in  the  /-th  row  and  £  mk  =  k.  In 

,-i 

this  case  the  coordinates  of  the  aimpoints  can  be  determined  according  to  the  rows  to  which 
they  belong.  Typical  clusters  of  absorption  points  in  a  field  can  be  described  as  in  Figure  2, 
when  the  points  have  bivariate  normal  distributions  along  aimpoint  rows  which  are  not  parallel 
to  the  x-axis. 

B.  The  encounter  model 

In  the  present  study  we  consider  a  general  model  based  on  the  following  assumptions. 

(i)  Absorption  points  act  independently  of  each  other. 

(ii)  In  each  encounter,  independently  of  the  past  history,  an  absorption  point  can  be 
detected  and  destroyed.  The  probability  of  detection  pJel,  remains  fixed  throughout 
all  the  encounters. 

(iii)  An  undetected  absorption  point  may  be  activated  with  probability,  pai.„  independently 
of  any  previous  event.  If  a  point  is  activated  it  is  destroyed. 
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(iv)  A  particle  activating  an  absorption  point  is  either  absorbed  or  survives.  The  probabil¬ 
ity  of  absorption  at  each  activation  is  pk.  In  each  case  absorption  or  survival  are 
independent  of  the  previous  events. 

In  the  previous  studies  of  Zacks  and  Goldfarb  [6)  and  Parsons  (5)  no  detection  was  allowed  and 
if  a  point  was  activated  the  particle  was  always  destroyed. 

3.  SCATTER  DISTRIBUTION  MODELS 

In  each  cluster  the  N  points  are  distributed  identically  and  independently  according  to 
some  specified  distribution.  The  scatter  distributions  do  not  have  to  be  the  same  at  different 
clusters.  In  the  present  section  we  discuss  the  bivariate  normal  and  the  uniform  scatter  distri¬ 
butions.  The  methodology  remains  the  same  if  other  distributions  are  chosen. 

Let  (X,r  Y,,)\  j  —  1 . N,  and  /  —  1.  ....  k  designate  the  coordinates  of  the  y-th 

absorption  point  at  the  /-th  cluster.  The  (jr.y')  coordinates  system  is  the  one  with  origin  at  the 
center  of  the  field  and  axes  parallel  to  the  rectangular  sides  of  the  field  (Figure  1).  The  absorp¬ 
tion  point  may  be  scattered  over  the  field  according  to  another  coordinate  system  (x\  y  ),  which 
can  be  obtained  by  a  rotation  of  the  (x.y)  system.  We  introduce  the  ( x',y ')  system  since  the 
aimpoints  may  be  scattered  (for  example,  from  the  air)  along  aimpoint  rows  which  are  not 
parallel  to  the  (x..y)  axes.  We  denote  by  #  the  angle  between  the  x  and  x'  axes.  It  is  well 
known  that  the  (x.y)  coordinates  can  be  obtained  from  the  (x'.y')  coordinates  by  the  orthogonal 
transformation 

(3 


.1) 


cos#  -sin# 
sin#  cos# 


Y’  Y  X' 


Eigurc  I.  Ellipsoids  of  conceruraiion 
of  scalier  distribuiions 
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Figure  2.  Nine  clusters  of  .V-50  points.  Bivariate  normal  distributions 
<tx  —  <tv  -  5m.  L  -  W  =*  200  m. 
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3.1  The  Bivariate  Normal  Model 

It  is  assumed  that  the  scatter  of  points  in  a  given  cluster,  according  to  the  (x'.y')  system, 
follows  a  bivariate  normal  distribution  whose  mean  is  the  aimpoint  Furthermore,  the 

random  variables  x'and  y'are  independent  with  variances  /r2  and  <r,2,  respectively.  In  terms  of 
the  (x,_y)  coordinate  system,  the  points  (x.y)  are  normally  distributed  with  mean  vector  (f,  r/) 
and  a  covariance  matrix 


(3.2) 

II 

<*n 

"*I2  <*22 

where 

<rn  =  <x2cos20,+  o-2sin20 

(3.3) 

*  y(<r;  ~  «■*)  sin(2<0 

<t22  “  o\2sin20  +  <r2cos2tf 

If  p  denotes  the  coefficient  of  correlation  between  x  and  y ,  i.e.,  p  =  o-l2/V^n  <*2i-~  then  the 
joint  probability  density  of  (x.y)  is 


If .  *).<*  1 1.  o’  1 2 ,  cr 22) 


(3.4) 
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where  f3  —  p-^/  — L.  As  mentioned  earlier,  the  parameters  of  this  bivariate  normal  distribu¬ 
tion  may  differ  from  one  cluster  to  another. 


3.2  The  Distribution  of  the  Number  of  Absorption  Points  in  a  Crossing  Path 

Consider  a  crossing  path  centered  at  the  breaching  point  (B,  -WIT).  The  width  of  the 
crossing  path  is  DL. 


Let  J,  be  the  number  of  absorption  points  of  the  ;-th  cluster  which  (randomly)  fall  in  the 
crossing  path.  We  assume  that  J\,  J2,  ,  Jk  are  independent.  Furthermore,  if  the  /-th  cluster 

has  /V,  absorption  points  then  the  distributions  of  J ,  is  binominal  with  parameters  N,  and  <A,'. 
where  1 It,  is  the  probability  that  a  point  from  the  /-th  duster  will  fall  in  the  path.  We  call  <//,  the 
coverage  probability  of  the  /-th  cluster,  formulae  for  1 1>,  in  the  bivariate  normal  case  are  obtained 
as  follows. 

Let  <t>(u)  and  <D(u)  denote  the  p.d.f.  and  the  cumulative  distribution  function  (c.d.f.)  of 
the  standard  (univariate)  normal  distribution.  Then 
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Since  £>Z.  is  generally  substantially  smaller  than  yJ<J\\  a  good  approximation  for  (3.5)  is 
obtained  by 


(3.6) 


+  <t> 
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Alternatively,  one  can  apply  any  program  which  computes  bivariate  normal  probabilities  of  rec¬ 
tangles  for  the  determination  of 


3.3  The  Distribution  of  J 

As  mentioned  'earlier,  the  number  of  absorption  points,  J,  in  a  crossing  path  is  a  sum  of  k 
independent  binomial  random  variables  J t,  ....  Jk.  These  binomial  random  variables  have 

different  coverage  probability  parameters,  «//,(/  =  1 . k).  Hence,  the  distribution  of  J  is 

not  binomial.  One  can  determine  the  formula  of  the  probability  distribution  function  of  J  by 
determining  first  its  generating  function.  We  obtain  that,  if  <o,  =  <|/,/(1  —</»,),  /  =  1 . k ,  and 

Q  =  V'  then 

/-I 

P{J\  +  •••  +  Jit  =  ,  0a) 


(3.7) 
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r  =  0,  1 . Nx  +  ■■■  +  Nk. 


When  A,  is  large  and  <!>,  small  one  would  encounter  difficulties  in  computing  these  proba¬ 
bilities  exactly.  In  these  cases  the  Poisson  approximation  is  generally  applicable.  The  distribu¬ 
tion  of  J\  +  ••  •  +  Jk  is  well  approximated,  when  0 ,  are  small  and  N,  are  large,  by  the  Poisson 

distribution  with  mean  \  —  ]T 
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4.  THE  SURVIVAL  PROBABILITIES  OF  PARTICLES 

In  the  present  section  we  develop  the  formulae  of  the  survival  probabilities  of  each  one  of 
n  particles  crossing  consecutively  in  a  given  path.  As  before,  let  J  denote  the  number  of 
absorption  points  in  the  breaching  path.  We  assume  here  that  all  these  points  are  non¬ 
defective.  Let  s  denote  the  probability  of  survival  when  the  object  passes  in  the  vicinity  of  an 
absorption  point.  From  the  assumption  of  the  model 

(4  ^  s  =  Pdel  +  0  ~  />dc.)  Hi  -  Pan 1  +  PacM  ~  />*))• 

Let  S„  denote  the  event  that  the  /i-th  object  to  cross  a  path  survives.  Since  the  encounters  are 
independent  it  is  obvious  that 

(4.2)  m,Ul  =  s'. 

The  survival  probability  of  the  first  particle  is  then  the  expected  value  of  the  conditional  proba¬ 
bility,  i.e., 

(4.3)  -  £{s'). 

We  develop  now  general  recursive  formulae  for  the  determination  of  survival  probabilities 
PIS,,)  for  all  n  >  2. 


Let  M„,  n  —  1.2,  ...  be  a  random  variable  designating  the  total  number  of  absorption 
points  destroyed  (detected  or  activated)  during  the  first  n  attempts  to  cross  in  a  given  path. 
Obviously, 

(44)  P[S„\M„-\.  J)  =  all  n  =  \,  2,  ... 

where  M0  =  0.  Thus,  if  we  determine  the  conditional  distribution  of  M,  given  7,  for  all  /  =  1, 
2.  ...  we  can  obtain  from  (4.4)  the  conditional  probability  of  S„  given  7,  namely 

P[S„\J]  =  £  PiS„|Mn_,  -  r.J)  ■  P\M,_X  -  r|y] 


=  £  s'"' />[*/„_,  =  r  |  y ] . 

r-0 

For  each  n  —  1,  2,  ...  let  A„  denote  the  number  of  absorption  points  destroyed  in  the  n-th 

attempt  to  cross  the  path.  Since  M„  =  M„_,  +  for  n  =  1,  2 . we  obtain  the  (recursive) 

relationship,  for  all  r  =  0.  =  1 . J  and  every  n  =  1,  2,  ... 

(46)  PlM„  =  r\J\  =  £  P[\„  =  A  |  A/„_,  =  r-k.J]  ■  -  r-k\J). 

k-  0 

Moreover,  for  every  n  =  1 ,  2,  . . .  ;  k  =  0 . r  ; 

(4-7)  P[  A„  =  k  |  A/„  _ ,  =  r-k,J]  =  P{M,  -  k\J  -  r+k]. 

Hence,  from  (4.6)  and  (4.7)  we  obtain 

(4  8)  P[Mn  =  r|7]  =  £  P[M,  =  k\j-r+k]  P[M„_ ,  =  r-k\J\. 


Thus,  if  we  develop  explicit  formula  of  P\M\-r\J-j\  for  all  j  =  0,  1,  ...  and 

r  =  °.  1 . j  then  we  can  obtain,  by  repeatedly  applying  (4.8),  the  values  of 

P\M„  =  r\J  =  /)  for  all  n  ^  2,  r  =  0 . ./  and  j  =  0,  1 .  This  explicit  formula  will  be 

derived  in  the  sequel.  We  return  now  back  to  (4.5).  The  conditional  probability  of  S2  given  J 
is 
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(4.9) 


m3|yl  -  ±  sj~'  P[M ,  -  r\J]. 

r-0 


For  n  >  3  we  obtain  from  (4.5)  and  (4.8) 


(4.10) 


P[S„\J)  =  £  s7-'  £  P[M„-2  =  *1^]  PI  A/ 1  -  /--Ar|y-*] 

r-0  lk-0 

-  s7  £  />[A/„_2  -  k  |y]  £  -  r—k  \j—k ] 

;-0  r-k 

=  s7  £  s-*  a>[a/„_2  =  k | y ]  j;  s-  /»[a/,  =  /|y-*l. 

A-0  :-0 

We  have  thus  established  the  recursive  relation,  for  all  n  >  3, 


(4.11) 


P[S„\J]  =  £  PlM„-2  =  i-|y]  P[S2\J~r]. 


As  seen  in  formulae  (4.8)  and  (4.9)  the  key  to  the  recursive  solution  is  in  the  explicit  expres¬ 
sion  of  P[M\  =  r\J].  We  derive  now  the  formula  for  these  conditional  probabilities.  We 
notice  first  that  no  absorption  point  is  destroyed  in  the  first  crossing  if,  and  only  if,  there  were 
no  detections  and  no  activations.  Thus, 

(4.12)  P[M\  =  0 1  y  ]  =  w7 

where  w  =  (l-/tdel)  (1  -pa„).  Similarly,  the  event(A/|  =  y)  is  possible  if,  and  only  if,  all  the 
first  y  absorption  points  have  been  either  detected  or  activated  and  the  particles  survived  at  least 
the  first  y-1  encounters.  Thus, 

(4.13)  P[M\  =  y | y)  —  (1  — w)  (s  — w)7-1. 


In  the  other  case  (r  points  destroyed;  r  =  1 . J— 1)  we  distinguish  between  two  possibili¬ 

ties.  The  first  one  is  that  the  particle  has  survived  the  r  encounters,  in  which  the  points  have 
been  destroyed,  and  the  other  one  is  that  it  has  been  also  destroyed.  The  probability  of  r 
absorption  points  destroyed  and  the  particle  surviving  is  |^J  (s-w)f  wJ~r.  On  the  other  hand  if 
the  particle  is  also  destroyed  it  could  have  been  destroyed  only  after  the  first  r— 1  encounters. 
Accordingly,  the  probability  of  r  absorption  points  destroyed  and  the  particle  destroyed  too,  is 


(4.14) 
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where  G(j\$,v)  is  the  c.d.f.  of  the  negative-binomial  probability  distribution,  having  a  proba¬ 
bility  function 


(4.15) 


$(y|»M) 


r(y+y) 

r(y+i)r(y) 


(1—0)*  <K 


y  «  0,  l,  ;  0  <  0  <  1  and  0  <  v  <  °°.  Accordingly,  from  (4.12)  —  (4.14)  we  obtain  the 
general  formula 


(4.16) 


/MM,  =  r\J  1 


w7  ,  if  r  *=  0 

(r)  wJ~r(s~w)'  + 

G(J-r\w,r)  ,  if  r  =  1 . y-1 

(1  — w  (s  —  w)7-1  ,  if  r  —  y 


1-s  s-w 
1— w  1— w 
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U  can  be  shown  that  P[M,  =  r\J\  *  1  for  all  J  =  0,  1 .  Thus,  the  computing  algo- 

r- 0 

rithm  should  start  with  the  computation  of  the  values  of  P[M{  =  r\J]  for  all  J  -  0,  1,  ...  and 

r  *■  0.  1 . J.  In  the  second  stage  of  the  computations  the  conditional  probabilities  P(s|y) 

can  be  determined  for  each  y  —  0,  1,  ....  These  probabilities  are  then  multiplied  by  the  pro¬ 
babilities  of  J  and  summed  over  all  j  —  0,  1,  2,  ....  This  sum  will  provide  the  probability 
In  more  progressive  stages  we  compute  P[M„  -  r\J]  and  PlSjy]  according  to  the  pre¬ 
vious  recursive  formulae  and  then  determine  the  weighted  average,  the  conditional  probabilities 

mui. 

We  remark  that  since  M„  >  A/„_|,  with  probability  one,  for  all  n  >  1,  and  since 
0  <  s  <  1, 

(417)  M„]  *=  sJ~M "  >  -  P[Sn\J,  M„] 

with  probability  one.  Hence, 

(4.18)  /,[S„+I]  ^  PIS,,],  »  -  1.  2 . 

This  result  is  intuitively  clear.  Each  particle  crossing  a  field  in  a  certain  path  has  higher  survival 
probability  than  those  of  the  particles  crossing  previously  at  the  same  path. 

We  remark  here  that  if  the  Poisson  approximation  of  the  distribution  of  J  is  applied  we 
obtain 

/,[S1]  =  £|sy)  *  exp|-A(l-s)). 

For  all  n  >2  we  obtain  P[S„]  by  averaging  />[S„|y=y]  with  respect  to  the  Poisson  probabilities 
p(j\K)  =  e-*A'/y!,  ;'  =  0,  1,  ....  In  the  numerical  computations  we  sum  over  j  —  0,  ...,  JT. 
If  A  is  small  we  fix  a  proper  small  value.  For  large  A  we  set  JT  =  INT(X  +  3>/A)-  +  1,  where 
/iVr(A)  is  the  integer  part  of  A.  Moreover,  in  the  Poisson  case  we  can  treat  the  problem  of 
defective  absorption  points  (duds)  very  simply.  If  there  are  J  points  in  a  crossing  path  and  the 
probability  of  "dud"  is  pdud  then  the  number  of  active  points  in  the  path,  J*  has  a  binomial  dis¬ 
tribution  with  parameters  yand  P  =  \-pdlld.  Since  J  has  a  Poisson  distribution  with  mean  A  it 
is  well  known  that  J*  has  (marginal)  Poisson  distribution  with  mean  A*  -  A(l-pjl(^).  Thus, 
we  have  to  determine  the  expectations  of  the  conditional  probabilities  /MSjy)  with  respect  to 
the  Poisson  distribution  with  mean  A  *. 

Finally,  the  expected  number  of  particles  that  survive  crossing  in  a  column  of  n  can  be 
obtained  by  adding  their  respective  individual  probabilities.  Indeed,  if  we  denote  by  /,  a  ran¬ 
dom  variable  which  assumes  the  value  1  if  the  /-th  particles  in  a  column  survives  and  the  value 
zero  otherwise,  then  PIS,]  =  £{/,),  /  —  1,  2 . n.  Moreover,  the  total  number  of  objects 

n 

among  n  attempting  to  cross  the  field  in  a  column  which  survive  is  Xn  *  £  /,.  Accordingly, 

i  ■  i 
n 

E [Xn }  -  £  P[S,].  In  the  following  section  we  derive  the  distribution  of  Xn.  However,  for  the 

/-i 

determination  of  the  expectation  E[Xn )  that  distribution  is  not  needed.  In  the  following  table 
we  provide  numerical  results  obtained  according  to  the  recursive  formulae  developed  here. 
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TABLE  1.  Survival  Probabilities  of  Particles 
Crossing  in  a  Column 


Case  1 

Case  II 

Case  III 

n 

P(N„) 

E{X„\ 

P(Sn) 

P(S„) 

£U„] 

i 

0.01850 

0.0185 

0.13601 

0.1360 

0.16843 

0.1684 

2 

0.05306 

0.0716 

0.29144 

0.4275 

0.24209 

0.4105 

3 

0.12852 

0.2001 

0.50502 

0.9325 

0.38551 

0.7960 

4 

0.25060 

0.4507 

0.70332 

1.6358 

0.53058 

1.3266 

5 

0.40656 

0.8572 

0.84330 

2.4791 

0.64798 

1.9746 

6 

0.56973 

1.4270 

0.92188 

3.4010 

0.72686 

2.7014 

7 

0.71347 

2.1404 

0.95770 

4.3587 

0.77236 

3.4738 

8 

0.82211 

2.9625 

0.97101 

5.3297 

0.79553 

4.2693 

9 

0.89328 

3.8558 

0.97504 

6.3047 

0.80623 

5.0756 

10 

0.93381 

4.7896 

0.97606 

7.2808 

0.81080 

5.8864 

The  parameters  of  the  field  are: 


Case 

A 

Pdet 

Pact 

Pk 

I 

10 

.25 

.70 

.80 

11 

5 

.25 

.70 

.80 

111 

10 

.25 

.50 

.50 

5.  THE  DISTRIBUTION  OF  THE  NUMBER  OF  SURVIVORS 


In  the  present  section  we  derive  recursive  formulae  for  the  determination  of  the  probabil¬ 
ity  distribution  of  the  (total)  number  of  particles  successfully  crossing  in  a  given  path.  Obvi¬ 
ously  P[X\  =  1 1 y]  =  sJ.  The  joint  conditional  probability  distribution  of  Xx  and  A/,,  given  J ,  is 


(5.1) 


P[Xx  =  1  ,Mi  -  r\j] 


|^J  wJ  '  (s-w)r 
,(s-w)J 


if  r  -  0 

if  r  =  1,  . . .  ,  J—r 
if  r  -  J 


The  derivation  of  (5.1)  follows  similar  arguments  to  those  of  (4.16).  Moreover, 


(5.2)  m,  =  0,  A/,  -  r\J]  -  P[M\  =  r\J)  -  P[Xx  =  1,  A/,  =  r\j]. 

The  joint  conditional  probability  distribution  of  ( X„,M„ ),  given  7,  is  determined  recursively  for 
n  =  2,3,...  according  to  the  formula: 

P[Xn  =  i,  M„  «  r\J] 

(5.3)  -  £/>[*„_,  -  /— 1.  M„.\  =  A: |y]  /'(A',  -1.  Af,  =  r-k\j-k] 

k  -o( 

+  m„_,  =  i,  A/,_|  =  lc|J]  PlA,  =  0,  A/,  =r-k\J-k) 

for  each  /  —  0 . n  \  r  —  0 . J ,  J  =  0,  1 .  From  this  joint  conditional  probability 

distribution  of  ( X„,M„ )  given  J  we  obtain  the  conditional  probability  distribution  of  X„  given  J. 
Indeed, 


i 
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(5.4)  P[X„  =  i\J)  -  £  P[x„  =  i,  M„  =  r|y], 

r-  0 

Finally,  according  to  the  Poisson  approximation 

(5.5)  MAT,,  -  /)  =  £  pO|A)  =  i|y  -y], 

1-0 


In  the  following  table  we  provide  some  numberical  results  obtained  by  the  above  formu¬ 
lae. 


TABLE  2.  The  Probability  Distribution  of  the  Number  of 
Survivors.  n  =  l(l)10,  A  =  2,  pM  =  05.  pdcl  =  .25,  paa  =  .7  and  pk  -  .8. 


N«ss''''v\ 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

1 

0.300 

0.700 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

2 

0.06*6 

0.322 

0.612 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

3 

0.01 1 

0.083 

0.323 

0.583 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

4 

0.001 

0.01 5 

0.089 

0.323 

0.572 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

5 

0.000 

0.002 

0.017 

0.091 

0.322 

0.568 

0.000 

0.000 

0.000 

0.000 

0.000 

6 

0.000 

0.000 

0.002 

0.017 

0.091 

0.322 

0.568 

0.000 

0.000 

0.000 

0.000 

7 

0.000 

0.000 

0.000 

0.002 

0.017 

0.091 

0.322 

0  568 

0.000 

0.000 

0.000 

8 

0.000 

0.000 

0.000 

0.000 

0.002 

0.017 

0.091 

0.322 

0.568 

0.000 

0.000 

9 

0.000 

0.000 

0.000 

0.000 

0  000 

0.002 

0.017 

0.091 

0.322 

0.568 

0.000 

10 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.002 

0.017 

0.091 

0.322 

0.568 

It  is  interesting  to  note  that  when  A  is  as  small  as  in  the  above  example  the  mode  and  the 

median  of  the  survival  distributions,  for  each  1 . 10  is  at  X„  —  n.  Moreover,  for  all  n 

greater  than  a  certain  number  which  depends  on  parameters  of  the  example  (here  n0  —  4)  the 
distributions  are  related  to  each  other  by  simple  displacement. 

6.  EXAMPLE 

In  the  present  section  we  combine  the  procedures  previously  developed  to  determine  the 
expected  number  of  particles  that  survive,  under  the  following  field  structure. 

The  field  size  is  200m  x  200m.  There  are  nine  clusters  centered  at  £  =*  —50.0.50m  and  ij 
=  -50,0,50m.  Each  cluster  consists  of  N  —  50  absorption  points,  distributed  according  to  a 
bivariate  normal  distribution  with  &x  =  10m,  <rv  =  5m  and  angle  of  orientation  9  —  30°.  We 
compute  the  expected  number  of  survivors  in  columns  of  n  =  10  particles  breaching  in  twenty 
paths  of  width  DL  =  lm  spread  along  the  field  10  meters  apart.  In  the  following  table  we  pro¬ 
vide  the  value  of  A  *  for  each  path  and  the  expected  number  of  survivors  there.  We  also  give 
the  average  number  over  the  20  paths.  This  average  estimates  the  expected  number  of  sur¬ 
vivors  if  the  location  of  the  breaching  path  is  chosen  at  random. 
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TABLE  3.  Expected  Number  of  Survivors  in  Columns  of 
«  =  10,  />dc,  -  .4,  pac,  =*  .95,  pk  =  .7,  pdud  =  .2,  /»=  50. 


B 

A* 

E[X„) 

-95. 

0.000 

10.000 

-85. 

0.003 

9.999 

-75. 

0.114 

9.953 

-65. 

1.331 

9.452 

-55. 

4.552 

8.127 

-45. 

4.552 

8.127 

-35. 

1.334 

9.451 

-25. 

0.228 

9.906 

-15. 

1.334 

9.451 

-5. 

4.552 

8.127 

5. 

4.552 

8.127 

15. 

1.334 

9.451 

25. 

0.228 

9.906 

35. 

1.334 

9.451 

45. 

4.552 

8.127 

55. 

4.552 

8.127 

65. 

1.331 

9.452 

75. 

0.114 

9.953 

85. 

0.003 

9.999 

95. 

0.000 

10.000 

Average 

9.259 

Notice  that  X*  =  A (1  —  pdud).  We  see  that  the  smallest  number  of  expected  survivors  is  around 
the  aim  point-rows  at  -50,  0  and  50.  Due  to  the  symmetric  centering  of  the  nine  clusters 
"round  the  center  of  the  field  the  expected  number  of  survivors,  E[X„ }  is  a  symmetric  function 
of  the  distance  of  the  breaching  point,  B,  from  the  middle  of  the  field. 

7.  POSSIBLE  GENERALIZATIONS 

The  model  and  algorithm  discussed  in  the  present  paper  can  be  easily  generalized  and 
ex:ended  to  cover  the  following  cases: 

(i)  Delivery  errors:  the  centers  of  the  clusters  rj,)  are  randomly  distributed  around 
their  respective  aim  points. 

(ii)  The  detection  probabilities  may  change  from  one  particle  to  another  in  a  given 
column. 

(iii)  The  detection  probability  of  each  particle  may  increase  as  the  number  of  encounters 
of  that  particle  grows. 

(iv)  Particles  which  move  through  the  breaching  paths  in  jumps  (the  personnel  case). 

Another  interesting  problem  area  concerns  questions  of  optimal  choice  of  the  breaching  path, 
when  the  information  on  the  field  structure  is  incomplete,  the  statistical  analysis  of  the  field 
structure  (cluster  analysis)  from  observations  on  the  results  of  encounters,  and  similar  prob¬ 
lems  of  pattern  recognition. 
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lor  each  it.  V|(tt),  Vjl n) . X„(n)  are  IID.  wilh  common  pdr  /„<v) 

T|(«)  <  ...  <  T„(h)  arc  the  ordered  values  of  Vl(«) . X„(n).  K„  is  a 

posilive  inieger,  wilh  lini  K„  =  °°.  Under  certain  conditions  on  A'„  and 

n—ao 

/„(  v),  it  was  shown  in  an  earlier  paper  that  the  joint  distribution  of  a  special  set 

of  K„  +  I  of  tlie  variables  >,(//> .  >„<«)  can  be  assumed  to  be  normal 

for  all  asymptotic  probability  calculations.  In  another  paper,  it  was  shown  that 
if  /„<v>  approaches  the  pdf  which  is  uniform  over  (0,  I)  at  a  certain  rale  as  n 
increases,  then  the  conditional  distribution  of  the  order  statistics  not  in  the  spe¬ 
cial  set  can  be  assumed  to  be  uniform  for  all  asymptotic  probability  calculations. 
The  present  paper  shows  that  even  if  /„(v)  does  not  approach  the  uniform  dis¬ 
tribution  as  n  increases,  the  distribution  of  the  order  statistics  contained 
between  order  statistics  in  the  special  set  can  be  assumed  10  be  the  distribution 
of  a  quadratic  function  of  uniform  random  variables,  for  all  asymptotic  proba¬ 
bility  calculations.  Applications  to  statistical  inference  arc  given. 


1.  NOTATION  AND  ASSUMPTIONS 


For  each  positive  integer  n ,  the  continuous  random  variables  X](n) . X„(n )  are  IID, 

with  F|(/i)  <  ...  <  Y„(rt)  denoting  their  ordered  values.  For  typographical  simplicity,  from 
now  on  we  write  X,(n ),  Y,(,n)  as  X,,  Y,  respectively. 


./„(*)  and  F„(x )  denote  respectively  the  common  pdf  and  cdf  for  X,. 


all  n,  all  x,  and  for  r  =  1,  2,  3,  4,  f„(x)  exists,  and 

dx' 

assume  that  f„(x)  <  <  °°  for  all  n  and  all  x. 


We  assume  that  for 
A|  <  We  also 


For  each  n,  we  choose  values  p„,  q„ ,  and  L„  to  satisfy:  0  <  p„  <  q„  <  1;  L„  is  a  positive 


integer  such  that  lim 


1  for  some  fixed  8  in  the  open  interval  0,  -jy 


;  np„  and  nq„ 


ii-oo  n2/}  +  * 

n  ( q„  —  p„) 

are  integers;  - - -  =  K„,  say,  is  an  integer,  lim  p„  -  0;  Um  q„  -  1;  lim  np„  —  lim 

L„  it— »  “  n—«o  n— « 

n (1  —  q„)  -  - 7~T\ - >  A3  >  0  for  all  x  <  F„  '(p„)\  and  - 7-77 -  >  A<  >  0  for 


/„(-*) 

all  x  >  F~'(qn). 

•Research  supported  by  NSI  Grant  No.  MCS76-06340 
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Define  b„  as  inf  1/„U):  F'Hp„)  x  <  F„  [(q„)).  We  assume  that  ny  <  b„ <  1  for  a 


,  „  38  1  6 

fixed  value  y  in  the  open  interval  0,  min  — ,  —  —  y 


For  j  =  1 . K„  +  1 ,  denote  F„ 


I  np, I  +  0-U  L„ 


by  T(j,  /;),  denote  f„(T(,j,  n )) 


i  1  i 

by  t(j,  n ),  and  denote  /(>.  n)  (  K^+tz-i)/.,,  ~  T(j,  «))  by  Z,(n).  For  7  =  1,  ■ 
denote  y  ( +  Y„Pn+lL)  by  ?,(»),  and  denote  ( bV  *M»)- 

Let  IF'(1,  j,  n),  ....  fF'(L„  -1,7,  n)  denote  the  L„  -  1  values  among  jA',,  ....  X„) 

Din)  -  D,(n) 

which  fall  in  the  open  interval  Yt(n) - y — .  Y,(n)  +  — - —  ,  written  in  random  order 

(that  is,  the  same  order  in  which  ,V| . X„  are  written).  For  /  =  1,  ....  L„  -  1  and 

W'U,  7,  n)  —  Y,in) 

7  =  1 . K„,  define  W(i,  j,  n)  as - ~5Tn) - ‘ 

Lei  g0„(z|,  ....  zA-  +|)  denote  the  joint  marginal  pdf  for.  Z,(n) . ZA+1(n).  g0,„  is 

easily  calculated,  and  is  given  explicitly  in  [3],  Let  ^(wd,  j) . w(L„  -  1,  y)|Z(n)) 

denote  the  joint  conditional  pdf  for  Hdl,  j,  n ),  ...  ,  W(L„  —  1,  j,  n),  given  Zin).  ...  , 
ZK  4l(w).  (Note  that  being  given  Z|(n),  ....  ZK+](n)  is  equivalent  to  being  given 

?,(») . ?*,(»),  Din),  ...  ,  DK(n).) 

g(„(»v(l,  j) . w(Z.„  -  1,  j)\Z (n))  = 

Y,1  Djn)  f,jY  jn)  +  Djn)w(i,  j)) 

ii  Din)  -  %  Din)  I 

F„  y,(n)  +  -y - F„  Yin)  -  | 

if  -  y  <  w(i,  j)  <  y  for  /  =  1 . L„  ~  1;  g,.„  =  0  otherwise.  Thus  the  joint  pdf  for  the 

K„L„  +  1  random  variables  (Z|(n),  ....  Z^+t(n);  WO,  j,  n)  for  i  =  1 . L„  —  1  and 

K„ 

7-1 . AT„1  is  K0.„  n  gj  „,  which  we  denote  by  g„. 

/-i 

Now  we  construct  an  "artificial"  joint  pdf  for  these  K„L„  +  1  random  variables,  as  follows. 
The  joint  marginal  pdf  for  Zin) . ZK„+in)  is  the  joint  normal  pdf  /i0  „(z| . “X„->-i) 

defined  as 


(VSF)  " 


m  exp  r 


n(L„  -  1)  L„z J  L»zi<„+ 1 
2  Lj  np„  n(\  -  q„) 


+  si  (2/+ 1  -  :i'>2 


where  the  value  C„  is  given  explicitly  in  [3],  Under  the  artificial  distribution,  the  K„(L„  -  1) 
random  variables  [W(i.  j,  «)}  are  mutually  independent,  and  are  independent  of 

Zin),  ....  ZK  +](«),  with  distributions  constructed  as  follows.  Let  U(i,  j)  ('  =  1 . 

L"  -  1;  j  =.  l . K„)  be  independent  random  variables,  each  uniformly  distributed  over 


THE  ASYMPTOTIC  DISTRIBUTION  OF  ORDER  STATISTICS 


439 


(0,  1),  and  independent  of  (Z,(w) . ZA+I  (/?)).  Denote  F~'  | - ' - ' — |  by 

i„\  L"  /«(«((«))  .  ,  ,  „ 

a^n),  and  ^  f*(a  (n))  yAa^  for  j  =  1,  ....  K„.  Then  the  distribution  of  W(i,  j,  n ) 


np„  + 

1 

J~2 

L„ 

■  1 

is  to  be  the  distribution  of  —  ^  +  0  +  y,(n))  U(i.  j)  —  yj(n)U2(i,  j).  Assuming  that  n  is 

large  enough  so  that  |y,0i)|  <  1  for  j  -  1 . K„ ,  the  pdf  for  W(i,  j.  n)  is  then 

[1  +  yj(n)  —  4 yl(n)w(i,  y)]  *'■  for  —  —  <  w(i,  j )  <  y,  and  is  zero  otherwise.  Denote  the 
pdf  by  hj„(w(i,  j))  Then  the  artificial  joint  pdf  for  all  K„L„  +  1  random  variables  is 

K  n  I 

h0nb\ . ZK„  + 1>  II  II  hi-  „«'(/,  j),  which  we  denote  by 

/-i  i-i 


If  Sn  is  an  arbitrary  measurable  region  in  (K„L„  +  1) -dimensional  space,  let  PK  (S„), 
Ph(S„)  denote  respectively  the  probabilities  assigned  to  S„  by  the  joint  densities  g„,  It,,”  The 
next  section  is  devoted  to  proving  the  following  Theorem: 

lim  sup  | PK  ( Sn )  -  P„  (S„)|  -  0. 

n—’oo  Sn  "  n 

2.  PROOF  OF  THE  THEOREM 


Throughout  this  section,  it  will  always  be  assumed  that  the  joint  distribution  of  the 
K„L„  +  1  random  variables  is  given  by  the  density  As  stated  in  [3],  the  theorem  will  be 
proved  if  we  show  that 


xAZ^n) . ZA+l(/i),  W(  1,  I,  n) .  W(Ln  -  I,  K„.  n)) 

MZt(») . ZAn  +  1(/»),  W(  1,  1,  n ) .  W(L„-  1,  K„,  n )) 


converges  stochastically  to  zero  as  n  increases.  Let  /?„(/,  j,  W(i,  j,  n))  denote 


DAn)fn(Yj(n)  +  D,(n)  W(i,  j,  „ )) 

Fn 

[?/»)  +'2  -  F„  F,(«)  - 

■J\  +  y}(n)  -  4y,(n)  W(i,  j,  n) 

Then  (2.1)  can  be  written  as  the  sum  of  the  two  expressions 


(2.2) 

log 

£0.„(Z|  (»),  .. 

•  -  Z*„+ |(if)) 

hQ  „(Z\(n),  . . 

•  .  Z*.+l(»)> 

K 

n 

(2.3) 


£  X  F„(i,  j.  W(i,  j,  n )). 

/-I  i-i 


The  fact  that  the  expression  (2.2)  converges  stochastically  to  zero  as  n  increases  is  the  theorem 
of  [3];  it  is  easily  verified  that  the  assumptions  of  [3]  are  implied  by  our  present  assumptions. 
Thus  we  only  have  to  verify  that  the  expression  (2.3)  converges  stochastically  to  zero  as  n 
increases. 

Let  /3n  denote  inf{/„(x):  T,(/,  <  x  <  ).  We  are  going  to  compute  the  conditional 

mean  and  the  conditional  variance  of  the  expression  (2.3)  given  (Z,(«) . 
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ZK  +|(/i)|  =  Z(n),  say,  under  the  artificial  distribution.  Denote  the  conditional  mean  and  the 

conditional  variance,  given  Z(w),  of  the  expression  (2.3)  by  m„(Z(n ))  and  v„(Z(«))  respec¬ 
tively.  Computing  E[R„(iJ,  W(i,j,n)\Z(n)\  and  E[R,}(.i,  j,  M/(/,  j,  n)\Z(n)\  by  the  formulas 

JU*  R„(i,  j,  w)h,„(w)iiw  and  R,j(i.  j.  w)h,„(w)dw ,  tedious  but  routine  calculations 

show  that  these  two  integrals  can  be  written  respectively  as 


1  /.<?,<«» 


24  l/„(  K/(n)) 


D/(n)  -  2y ,(n)  +  £  V,,(n)y'l(n) 


i  /„(y,-(«)) 


D,(n)  -  2y ,(//)  +  £  V,‘l(n)y'l(n) 


12  l  /„(K;(n))  ]  ,-u  I  I 

where  there  is  a  finite  constant  V  such  that  |  K,  ,(n)|  <  V  and  |  V,.,(n)  |  <  (  for  /  =  0,  1,  2,  3, 
4,  and  for  all  j  and  n.  Noting  that,  under  the  artificial  distribution,  the  joint  conditional  distri¬ 
bution  of  {«„(/.  j ,  W(i.  j):  i  -  1 . Ln  -  1;  j  -  1 . *„},  given  Z(«),  is  that  of  mutu¬ 

ally  independent  random  variables,  we  find 

U.-D  M/„<F#(»>> 


))  =  - 


J  n  / 

24  ./.<?,(«» 


D,(/t)  -  2y,(«) 


+  (£„  “DLL  p — j  and 

K"  4  _  DAn)  4 

+  a„  -  1)  I  I  K(»y;<«>  -5—  . 

,-l  /-0  P" 

where  there  exists  a  finite  constant  F  such  that  |  V,  ,(w)|  <  l7  for  /  =  0,  1,  2,  3,  4  and  all  j  and 


The  rest  of  this  section  is  devoted  to  showing  that  m„(Z(n))  and  v„(Z(/i))  both  con¬ 
verge  stochastically  to  zero  as  n  increases,  which  clearly  implies  that  the  expression  (2.3)  con¬ 
verges  stochastically  to  zero  as  n  increases,  thus  completing  the  proof  of  the  theorem. 

First  we  investigate  /3„.  If  Y„Pn  <  F~Hp„),  let  y  be  any  value  in  [ Y„Pn,  F~'(p„)],  so 

y  =*  F~'(p„)  +  r-9Z'('n.)  -  with  -1  <  9  <0.  Then  we  can  write  f„(y)  - 

y/nfn(F„  '(/>„)) 


fJF-'(p„ ))  + 


Vn  fAF~Hp„Y)  ^ff„ 


It  was  shown  in  (3)  that  — '-=r-  has  asymptotically  a  standard  normal  distribution,  and  since  p„ 

v  Pn 

approaches  zero  as  n  increases,  it  follows  that  with  probability  approaching  one  as  n  increases, 

/„(y)  >  bn - -X—.  Similarly,  if  Ym  >  F,;'(q„),  we  can  show  that  for  any  value  y  in 

yJnb„ 

\F^Hq„),  Ynq),  f„(y)  >  b„. - X —  with  probability  approaching  one  a.  n  increases  Since 

"  ”  V/ii. 

1 

b„  >  it  follows  that  with  probability  approaching  one  as  n  increases,  /3„  £  —  n  v. 
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Let  <Ma)  denote  the  standard  normal  cdf.  In  (3]  it  was  shown  that  Variance  (Z,(«)  - 
Z,  ,<»))  -  — 1  (1  +  S„),  where  S„  approaches  zero  as  n  increases,  and  that  Variance  (Z,(/;)) 
<  <  oo,  (or  7  -1,  .  .  .  ,  K„  +  ].  From  these  facts,  and  from  the  inequalities 

m'n  •••  n£„,)  >  1  -  £  [1  -£(£,)]  for  any  events  £, .  £,„,  and  4>(x)  <1  - 

1 

JJnx  e  a"  X  >  '*  f°"ows  easily  that  if  c(,  c2  are  any  positive  values, 

_i  8 

£[  max  \Z,(n)  -  Zi-\(n)\  <  n  6  +  J+‘'] 

i  ™  * . ^  ii 

and 

P[  max  |Z,(n)|  <  n‘2l 
1-  •*„  +  > 


both  approach  one  as  n  increases.  We  take  a  value  c,  in  the  open  interval 
value  c2  in  the  open  interval  (0,  8  -  y)  for  use  below. 


0. 


and  a 


From  the  definitions  above,  we  have 

?/<»>  -  y  (T(J  +  1,  n)  +  T(j,  «))  +  y±=- 


Zl+i(n)  Z,(«) 


D,(n)  -  T(j  +  1,  n)  -  T(J,  n)  + 


1 


r(j  +  1.  n)  t{j,  n) 
Z,  +  1(«)  Z,(n) 


yfn  ( t(J  +  1,  n)  t(j,  n) 

Simple  expansions  give 

T(j  +  1,1,)-  «»  +  —  S  +  F,  ,(*) 

2nf„(ot ^n))  nb„  J 

L„ 


T(j,  n )  =  o,(n) 


2nf „(a  j(n)) 


+  y2.,(n) 


1  L  1 

**/f 

nb„ 


,U  +  .  ..>-/.U,(.>>  +  £^L+^,.> 

-U  .)-/,(«,(»))  -  4  |£ 


2«  /„(ay(n)) 

where  |  F,/(«)|  <  F  <  oo  for  /  -  1,  2,  3,  4,  all  n  and  j,  and  some  constant  F  Using  these 
facts,  and  the  results  above  on  the  orders  of  magnitude  of  max  |Z,(„)  -  Z,_,(/j)|, 

max  |Z/(»)|,  and  f3„ ,  we  find  that 


max 
/-I . A 


Py(») 


Op(n~2,3+2y+u), 


nf„(ot,(n)) 
max  |  F,(«)  -a,(„)|  -  0/)(/,Cj_1/2+>), 


/-I . A 


and 


max 

■ . A„ 


/.(P/(»))  /„<«,(*)) 


/„(?,(«)>  /„<«>)) 
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where  (),,  has  the  usual  meaning.  Using  these  order  relationships  in  the  expressions  for 
m„(Z(ti))  and  v„(Z(n))  given  above,  we  find  that  both  these  expressions  converge  stochasti¬ 
cally  to  zero  as  n  increases,  completing  the  proof. 

3.  EARLIER  RESULTS,  AND  EXTENSIONS 

In  (4),  it  was  shown  that  if  f„(x)  assigned  probability  one  to  the  unit  interval,  and 
max  |/„(x)  —  l|  approached  zero  rapidly  enough,  in  the  artificial  distribution  we  can  set 

0£t<l 

y j(n)  =  0  for  all  /;  and  all  j. 

In  the  present  case,  several  generalizations  are  possible.  A  few  will  now  be  sketched. 

If  /„( x)  assigns  probability  one  to  a  bounded  interval,  and  is  bounded  away  from  zero 
over  the  interval,  we  can  treat  the  order  statistics  below  Y  and  above  in  the  same 
manner  as  we  treated  the  order  statistics  falling  between  and  This  was 

done  in  [4]  for  the  special  case  where  J„(x)  approaches  the  uniform  density. 

Several  of  the  assumptions  made  above  are  convenient  but  not  necessary.  For  example,  it 
is  not  necessary  that  b„  be  less  than  or  equal  to  one.  It  was  assumed  that  b„  <  1  in  13]  merely 
to  avoid  having  to  modify  the  argument  to  take  account  of  the  two  separate  cases,  b„  ^  1  and 
b„  >  1.  Similarly,  it  is  not  necessary  that  p„  approach  zero  as  n  increases,  or  that  q„  approach 
one  as  n  increases. 

Under  certain  conditions,  it  is  possible  to  take  L„  asymptotically  equivalent  to  n 1  2+s,  as  in 

111. 

4.  APPLICATIONS 

In  the  applications,  the  actual  joint  distribution  is  £„,  but  the  artificial  distribution  is 
used  for  asymptotic  probability  calculations,  because  it  is  simpler  and  more  convenient. 

j  —  y  —  n 

As  a  first  application,  suppose  f,Xx)  =  —  /  - ^  ,  where  p  and  cr  are  unknown 

(T  <r 

parameters  (with  cr  >  0),  and  /  is  a  known  function.  It  is  easily  verified  that  in  this  case, 
•y,(n)  does  not  depend  on  p  or  cr,  which  means  that  asymptotically,  if  we  are  given  the  values 
( Y„p  Y„P"+it,  1,  then  the  other  order  statistics  falling  between  Y„Pn  and  contain 

no  additional  information  about  p  and  cr.  In  some  cases,  such  as  when  f  is  a  normal  pdf,  the 
order  statistics  below  Y,w  and  above  asymptotically  contain  no  information  about  p  and  cr 

if  p„  approaches  zero  and  q„  approaches  one  at  arbitrary  rates  as  n  increases.  In  such  cases, 
asymptotically  efficient  estimators  of  p  and  ct  can  be  based  on  { Y„Pi,  Y„Pi+Ln,  ....  YllqJ  alone. 
Such  estimators  can  usually  be  given  as  linear  functions  of  (  Y„p  ,  L„,,,  w., . F„„  },  as  in  13]. 

A  second  application  is  an  extension  of  the  first.  Suppose  f„(x)  =  —  .7 

cr 

9] . 0,„J,  where  p,  cr,  «i . 9,„  are  unknown  parameters  (with  cr  >  0  and  possibly 

some  restrictions  on  9, . 0,„).  and  /  is  a  known  function.  In  this  case,  y,(n)  depends  on 

0, . 0,„,  but  not  on  p  or  cr;  we  write  it  as  y ,(0\ . «).  In  some  cases,  it  is  possible 

to  construct  estimators  of  0\  ....  based  on  ( Y„p^  Y„Pn  +  in .  F,„,  ),  with  the  following 

property.  Denote  the  estimators  by  0\(n) . W,„(n),  and  denote  y,(S|(n) . #„,(«);  n ) 
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h,„(WO 

j )) 

h,,,{WO 

J)) 

by  y,(n).  Finally,  denote  by  h,M(wO,  j))  the  pdf  which  is  equal  to  [1  +  y,(n)  -  4 yl(n)w(i. 
j) ]  '  ‘  if  ~  y  <  w ('■  <  y-  ancl  is  zero  otherwise.  The  property  desired  is  that 

!°g  n  n 

i-i  i-i 

converges  stochastically  to  zero  as  n  increases,  assuming  that  WO,  J)  are  independent,  with  pdf 
for  W(i,  j)  given  by  wO,  j)).  If  this  property  holds,  then  asymptotically,  if  we  are  given 
the  values  { Y„Pn,  Y„r+l^,  ...  ,  Y„qJ,  the  other  order  statistics  falling  between  Y,w  and  Y„q 
contain  no  additional  information  about  fi,  c r,  ...  ^9m.  This  is  so  because  if  we  are  given 

'  ^"p„'  . we  can  construct  the  pdfs  /?,  ,,,  and  then  generate  random  variables 

—  .  .  A‘-  L-~' 

W(i,  j)  whose  joint  pdf  is  f[  j)).  But  by  the  property  assumed,  and  the 

;-l  <-l 

theorem  above,  we  are  just  as  well  off  asymptotically  as  if  we  knew  all  the  m-der  statistics 
between  Y„„n  and  since  asymptotically  all  probabilities  are  the  same  for  (WO.  j))  as  for 
{WO,  j )). 


In  particular,  in  many  cases  we  can  find  estimators  9,(n)  such  that  for  /  =  1,  ....  m 
1  1  * 


|o»  =  o„ 


,  and  such  that  this  implies  that 


max 
/-I.  ,K„ 


-  -j-  yM\-  .  0,„;  n] 

L,n  L»n 


=  o„ 


In  such  cases,  the  estimators  can  be  shown  to  have  the  desired  property. 

For  the  next  two  applications,  we  introduce  the  following  notation.  #,(n)  is  to  denote 

)) 

T2(a\n))  ‘  ThC  observable  random  variables  W(\,  j,  n) . W(L„  -  1,  j,  n)  are  IID  with 

common  pdf 

-1/2 


L„ 

2 

L„ 

,+  2n 

0/0)  -  4 

9,(.n)w 

n 

for  -  y  <  w  <  y.  Denote  the  observable  quantity 


\2n 


L.- 1 


L.U,  -  1)  5  mt- J ■  "> 
by  0,0).  Using  the  representation  of  W(i,  j,  n)  as 

-  y  +  <i  +  ~  -  y «,MU20,  j), 

it  is  easily  shown  that  E(0,(n))  =  0,0),  and 

12  n2 


Variance  (0,0)  | 


L’U.  - 1)  I1  ~  ^  >,f")  +  iV 


In 


-  0,0) 


which  is  asymptotically  equivalent  to  ±jj-.  A  simple  calculation  shows  that  this  is  asymptoti¬ 
cally  equivalent  to  the  Cramer-Rao  lower  bound  on  the  variance  of  an  unbiased  estimator  of 


i 
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8,(n)  based  on  {W(\,  j,  n) .  W(L„-\.j,  «)).  By  the  central  limit  theorem,  the 

Ln'2  - 

asymptotic  distribution  of  -t=—  (0,(«)  —  0,(n))  is  standard  normal. 

v  1 2« 

As  a  third  application,  suppose  we  are  given  a  fixed  value  b  in  the  open  interval  (0,  1), 

and  we  want  to  test  the  hypothesis  that  -  -  0.  (This  may  be  part  of  a  test  that  F„ 

J„(F„  (o)) 

has  a  mode  at  F~'(b)).  Suppose  we  choose  p,n  q„ ,  and  L„  so  that 


np„  +  j  ~  y  L„ 


for  some  integer  j  between  1  and  K„,  say  j  =  J.  Then 

— ; - : -  -  9j(n), 

ft(F-'ib)) 

and  a  two-sided  test  of  the  hypothesis  with  asymptotic  level  of  significance  a  is  to  accept  if 

,  \  i  ,  I.  a  I 


|»((«)|  <  <1>~1  1  - 


2  Li 


A  fourth  application  is  to  the  device  called  "hedging"  in  an  earlier  paper  [2],  This  is  used 
to  modify  an  estimator  if  the  data  suggest  our  model  is  inaccurate.  Thus,  suppose  the  problem 
is  to  estimate  the  unknown  median  of  a  distribution.  If  we  think  the  distribution  is  normal 
(with  unspecified  mean  and  variance),  an  asympototically  efficient  estimator  of  the  median  is 

the  sample  mean,  but  a  certain  linear  combination  of  ( Y„Pn,  Ln . mentioned  in 

the  first  application  above,  is  also  asymptotically  efficient.  Denote  this  linear  combination  by 
Q(n).  On  the  other  hand,  if  the  distribution  is  not  normal,  Q(n)  may  be  a  very  poor  estima¬ 
tor  of  the  population  median.  We  now  describe  a  hedging  device  for  this  problem. 


Choose  p„,  </„,  and  L„  so  that  np„  +  jL„  -  y  for  some  j  between  1  and  K„,  so  that  the 

sample  median  is  one  of  the  variables  [Y„Pn,  Y„Pii+Lni  ■■■  .  Y„qJ.  If  f„(x)  is  actually  a  normal 
density,  then  9,(n)  is  equal  to  the  particular  value  8 ,(//)  defined  as 

np„  +  J  ~  y  L„  np„  +  J  -  -  L„ 

V2w  <t>^'  -  exp  —  4>_l  - 

n  2  n 

Let  S(fl)  denote  the  observable  random  variable 

b ,(n)  -  8 '(n) 

\ln2 

and  let  S*(n)  denote  the  nonrandom  nonnegative  quantity 
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Using  the  results  above,  it  is  easily  shown  that  the  asymptotic  distribution  of 

Sin)  -  iK„  +  S,’,(n )) 
yJ~2K„  +  4S*(») 

is  standard  normal.  Thus  an  observed  5(/»)  which  is  close  to  K„  is  evidence  that  f,  is  a  normal 
density.  The  hedging  device  is  to  use  Qin)  as  the  estimator  of  the  population  median  if 
S(n)  <  K„  +  C,',,  and  use  the  sample  median  if  Sin)  >  £,  +  C’,  for  some  nonrandom  C‘. 
The  choice  of  C„,  and  the  analysis  of  the  properties  of  the  overall  method  of  estimation,  can  be 
carried  out  as  in  (2],  The  analysis  is  particularly  easy  because  the  joint  asymptotic  distribution 
of  Sin),  Qin),  and  the  sample  median  is  trivariate  normal,  with  Sin)  independent  of  the  two 
other  random  variables. 
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ABSTRACT 

This  exposilion  presenis  two  algorithms  for  linear  programs  which  allow  a 
value  change  in  more  than  one  nonbasic  variable  at  each  iteration.  The  compu¬ 
tational  formulae  are  developed  and  errors  which  have  appeared  in  the  litera¬ 
ture  are  noted  One  algorithm  is  a  multiple  basis  exchange  procedure  while  the 
second  is  a  feasible  direction  method  There  remain  many  computational  chal¬ 
lenges  in  the  area  of  linear  programming  and  we  hope  that  this  investigation 
will  encourage  additional  work  in  the  directions  indicated  in  this  exposilion. 

1.  INTRODUCTION 

In  1947  George  B.  Dantzig  developed  the  primal  simplex  algorithm  for  solving  linear  pro¬ 
grams.  Variations  of  this  algorithm  have  been  developed,  such  as  the  dual  simplex  method  and 
the  primal-dual  method;  but  no  other  algorithm  has  ever  seriously  challenged  this  method  for 
solving  linear  programs.  Competing  algorithms,  such  as  Harold  Kuhn’s  Hungarian  Algorithm  [4] 
and  Delbert  Fulkerson’s  Oul-of-Kilier  Algorithm  13}  have  been  proposed  for  network  programs, 
but  generalizations  of  these  procedures  have  been  abandoned. 

We  find  it  curious  that  the  literature  contains  so  few  papers  concerning  other  algorithms 
for  such  an  important  class  of  problems.  We  assume  that  either  (i)  other  ideas  have  been 
investigated,  abandoned,  and  never  reported,  or  (ii)  the  simplex  method  has  proved  so 
effective  that  other  investigators  felt  no  motivation  to  work  in  this  area.  In  either  case  we 
believe  that  the  issue  should  not  be  closed  and  offer  two  basic  strategies  that  can  be  used  in 
algorithmic  development  for  this  problem. 

The  two  strategies  presented  in  this  paper  were  motivated  by  an  attempt  to  make  big 
jumps  rather  than  "crawling  along  the  edges"  of  the  convex  set.  The  first  strategy  involves  mul¬ 
tiple  column  exchanges  in  the  basis  rather  than  the  single  exchange  used  by  the  simplex  algo¬ 
rithm,  while  the  second  strategy  involves  cutting  across  the  middle  of  the  feasible  region. 
Algorithms  based  on  each  of  these  strategies  are  developed. 

Our  purpose  in  presenting  the  solution  strategies  and  algorithms  embodied  in  this  paper  is 
to  open  up,  for  consideration,  discussion  and  algorithmic  development,  the  idea  of  nonextreme 
point  solution  strategies  for  linear  programs.  The  development  process  for  computationally 
effective  algorithms  for  large-scale  problems  as  the  history  of  the  "simplex  algorithm"  itself 
reveals,  is  a  lengthy  process  to  which  many  people  ultimately  contribute.  In  the  course  of 
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investigation,  new  ideas  suggest  themselves  and  extensive  changes  are  made  to  algorithms,  as 
well  as  computational  strategies  for  implementing  the  algorithms.  The  algorithms  presented  in 
this  paper  should  be  viewed  as  points  of  departure.  One  of  them  is  under  active  investigation 
at  present.  It  is  hoped  that  others  may  also  wish  to  conduct  investigations  in  nonextreme  point 
solution  strategies. 

2.  MULTIPLE  BASIS  ENTRY 

The  linear  programming  problem  is: 

^  max  z  -  c'x 

subject  Ax  -  b 
x  >  0, 

where  A  is  an  m  x  n  matrix,  cand  xare  n-vectors,  and  b  is  an  m-vector.  In  (1)  we  assume  that 
r(A )  =  m  and  m  <  n. 


A  set  of  m  linearly  independent  columns  of  A  constitute  a  basis  matrix  B  and  so  the  con¬ 
straints  Ax  —  />can  be  rewritten: 


(2) 


(B.N) 


b. 


Since  B  has  an  inverse,  we  can  solve  (2)  for  xg,  yielding: 
(3)  xfl  -  B-'b  -  B~'Nxn. 


Since  x,v  -  0  for  a  basic  solution,  (3)  reduces  to 


(4)  xB  ”  B~'b. 

In  addition,  the  matrix  B  is  chosen  so  that  xg  ^  0.  In  the  pnmal  simplex  algorithm  one 
chooses  some  column  ak  of  N  to  enter  the  basis  and  one  column  br  of  B  to  be  removed  in  such 
a  way  that  the  value  of  the  objective  function  z,  after  the  change  of  basis,  is  greater  than  z.  It  is 
well  known  that  f  >  z  if  ak  is  a  vector  for  which: 


<5)  ~  (Ck  ~  z*)  >  0,  xBr  >  0,  yrk  >  0, 

yrk 

where  xBr  is  the  r"'  component  of  xB ,  yrk  is  the  r"'  component  of  yk>  Pk  ”  zk  =  cByk  and 

ck  is  the  k"’  component  of  c.  Hence  the  new  basis  B  that  is  obtained  from  B,  after  this 
exchange  of  vectors  is: 

B  —  . br-\,ak,br+],  ....  bm\. 

The  vector  br  lo  be  removed  from  the  basis,  is  chosen  in  such  a  way  that  the  new  basic  solu¬ 
tion,  xB  —  B  'b  ^  0,  i.e.,  it  is  a  basic  feasible  solution. 


What  we  wish  to  consider  in  this  section,  is  inserting  a  set  of  vectors  into  the  basis  and 
removing  a  corresponding  number  of  vectors  from  the  basis,  in  such  a  way  that  the  new  basic 
solution  is  feasible  and  the  new  objective  function  has  a  greater  value  than  the  previous  objec¬ 
tive  function.  In  brief,  we  wish  to  insert  a  set  of  vectors,  say  Sk ,  and  remove  a  set  Sr  of  the 
current  basis  vectors.  In  order  to  do  so,  we  need  to  know  the  following,  which  are  the  analo¬ 
gues  of  the  conditions  of  the  simplex  algorithm: 
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1)  Under  what  conditions  is  the  new  set  of  vectors  a  basis? 

2)  Under  what  conditions  will  the  new  objective  function  be  increased? 

3)  Under  what  conditions  is  the  new  solution  feasible? 


2.1  The  Existence  of  a  Basis 

First  we  shall  examine  the  question  of  maintaining  a  basis  in  the  multiple  entry  exchange 
of  vectors.  The  following  theorem  states  the  condition  for  maintaining  a  basis. 

THEOREM  1:  Let  B  —  ( A , .ft2*  •••  .  bm\  be  a  basis  for  Em.  Then  B  -  (a,,  fl2,  ,  ap, 
bp+ 1 . b,„ ]  is  also  a  basis  for  if  and  only  if  P  =  B~]B  is  nonsingular. 

PROOF:  Given  P  nonsingular,  we  wish  to  prove  that  B  is  a  basis.  Suppose  B  is  not  a 
basis.  Then  det  ( P )  =  det  (B~'B)  =  det  (£“’)  det  (B)  =  0  which  contradicts  /’nonsingular. 
Hence  B  is  a  basis. 

Given  that  B  is  a  basis,  we  wish  to  prove  that  P  is  nonsingular.  Clearly,  det  — 

det  (B~])  det (B)  ^  0  implies  £  nonsingular. 

Theorem  1  provides  a  necessary  and  sufficient  condition  for  a  basis  to  exist  if  we  replace 
several  basis  vectors  at  a  time.  It  does  not,  however,  insure  that  the  basis  will  result  in  a  feasi¬ 
ble  solution. 


2.2  Updating  Formulae 

For  our  multiple  basis  entry  technique,  we  propose  to  maintain  only  the  current  basis 
inverse  and  the  current  solution.  In  this  section  we  develop  the  updating  formulae  required  for 
maintaining  these  quantities  if  p  vectors  are  exchanged  in  the  basis. 

Recall  that  the  basic  variables  are  given  by 

xB  =  B~'b  —  B~'N  xn. 

We  partition  xB  and  xN  as  follows: 


*B\ 

SMl 

XB  = 

,  X  v  — 

XB2  ) 

where  xB\  will  correspond  to  the  p  columns  of  the  basis  B ,  that  are  to  be  replaced  by  p  columns 
of  N that  correspond  to  xVi-  In  other  words,  Z?and  Ware  partitioned  as: 


B  = 

p  x  p 

p  x  (m-p) 

Bu 

Bn 

( m-p )  x  p 

(m-p)  x 

(m-p) 

*21 

*22 
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and 


N 


p  X  p 

p  x  ( n—m—p ) 

*12 

( m-p )  x  p 

(m-p)  x 

*21 

*22 

(n—m—p) 

Since  we  are  replacing  the  first  p  columns  of  B  with  the  first  p  columns  of  N ,  it  is  clear  that. 


B  - 


*1. 

*1 2 

*2. 

*22 

We  also  note  that: 
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We  may  now  calculate  xB  from:  xh  =  B  '  b  =  (BP)~'b  —  P  1  B  [b  —  P  'xB 


Hence 

(9) 

From  (8)  and  (9)  we  obtain: 


*0  = 


Therefore  we  have: 


*0  =  P~'xB. 


Yu' 

0 

*01 

-Yu  Yu' 

/ 

*02 

it.1**, 


*02“  ^21  ^!l'*0l 


(10) 


■*0i  —  l|,iil*0i 
*02  =  *02  —  ^21^1l'*0l- 


We  now  have  formulae  for  maintaining  the  basis  inverse,  (7),  and  updating  the  solution,  (10), 
which  is  sufficient  for  executing  the  algorithm. 


2.3  Finding  an  Improved  Basis 

Given  the  results  of  section  2.2,  we  now  address  the  question  of  which  p  vectors  from  N 
should  become  basic.  Let  the  cost  vector,  c,  be  partitioned  as  follows,  c  —  l?Vi  cB2,  cB ,,  rV2J- 
Then  the  new  objective  function  may  be  written  as  follows: 

2  “  ?VI  *01  +  ?02  * 02* 

,  cr ]  and  c’B2  -  (c,,+| . cj.  From  (10)  we  have 

*01  ”  ^ll'*0l  ”  (*0|.*02 . *0/>l 

*02  =  *02  —  ^21  ^ll'*0l  =  *02  ~  ^21*01 

and 


(11) 

where  cv i  —  [ct,  . . . 


(12) 


*02  =  l*0.p  +  l'*0.p+2'  •••  •  *0m  1 


^21*01  ■=  Z-V,2*B7  I-  P  +  1, P  +  2 . m. 


7-1 


Combining  (11),  (12)  and  the  definitions  of  cNl,  cB2 ,  we  have: 


(13) 

In  (13)  the  terms: 

(14) 


2  -  L  f,*0/  +  L  c0< 

7-1  i-P+l 


*0,  ~  L  7*0/ 
7-1 


*0,  “  L  >7  7*0/ 
/-I 


a i liifciWiir  ■ri',)nni c  ^i-  L 
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are  missing  tor  /  -  1,2 . p.  However,  for  /  —  1,2 . pit  is  seen  from  00)  that 

*B\  “ 


or  in  component  form: 

p 

*b,  -  L  y>  >*Bi  '-1.2 . p. 

/-i 


Therefore  the  terms  given  in  (14)  are  zero.  Hence  we  may  rewrite  (13)  as: 

z  -  Z  c/*»/  +  Z  c*  oft  -  Z  y>  i*Bi 

i- 1  --I  i  /-i 


(15) 

Note  that. 


Z  +■  z 


/-l 


ci  -  Z  fft>’'  i 


XBi 


(16) 

Let 


Z  cft*ft 


/-I 


z, 


(17) 


Z  ‘W'/y 


/-i 


zj 


j  -  1.2 . p. 


From  (15),  (16)  and  (17)  we  have: 

*18)  Z  -  Z  +  £  (C/  -  Zj)xgj. 

j- 1 

We  see  clearly  from  (18)  that,  providing  the  xBi  >  0,  if  we  choose  vectors  to  enter  the 
basis  for  which  all  Zj  —  Cj  <  0,  j  —  1,2,  ,  pthen  £  ^  z.  Therefore  the  criterion  for  vectors 

to  enter  the  basis  is  the  same  as  it  is  for  the  single  vector  simplex  method. 

2.4  Feasibility  Considerations 


Let  us  now  examine  the  issue  of  how  to  choose  the  vectors  to  leave  the  basis  so  that  the 
new  solution  xB  is  feasible.  The  relations  that  must  be  satisfied  are: 

x B\  —  T||’  xfl|  ^  0 


(19) 


XB2  -  XB2  ~  T2I  I'll'  *81  ^  0. 


We  first  examine  the  simplest  case,  namely  the  one  for  which  p  —  2. 

Paranjape  (5)  studied  this  case  and  arrived  at  an  incorrect  set  of  criteria  for  the  vectors  to 
be  removed  from  the  basis.  Paranjape  maintains,  in  our  notation,  that  the  following  criteria 
guarantee  that  the  new  basis  and  basic  solution  will  be  feasible: 


1.  The  elements  of  Tn  must  be  non-negative  and  det(  T,,)  >  0. 
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2.  xfl).  xB2  correspond  to  the  removal  of  bu  b2 ,  from  the  basis  if: 


*b  i  .  I  XB,  ^  . 

-  ”  mini  — :  y,,  >  0 

y,  i 


*82 

yj2 


—  min 


He  chooses  two  vectors,  say  au  a2  to  enter  such  that  z,  —  C|  <  0,  z2  -  c2  <  0  are  the  most 
negative  and  then  uses  the  above  criteria  to  select  the  vectors  to  be  removed.  A  simple  counter 
example  to  Paranjape’s  method  is  as  follows. 

Suppose  at  some  iteration  of  Paranjape’s  2-variable  method  the  basis  is  for  convenience, 
an  identity  matrix,  i.e., 


1 

0 

0 

=» 

0 

II 

rs 

■ft 

1 

.  h  « 

0 

0 

lo 

1 

3) 

1 

.V12 

a,  - 

}  “ 

>21 

;  ai 

m 

4 

- 

>'22 

2} 

^31 

2 

-V32 

2 

xbi 

b  - 

3 

= 

XB  2 

2 

XB) 

Paranjape’s  method  would  calculate: 

*fli 

J'lt 

and 

XB2 

y  12 


min 


min 


111 

3 '  r  2 


2  2  1 

r  4’  2 


1 
3  ’ 


2 

4’ 


since  Tu 


.Vh 
yj  i 


(l  i)’  C*et^ii)  “  11-  Hence,  according  to  Paranjape,  since  detO'u)  > 

0,  the  above  criteria  for  removing  bu  b2  from  the  basis  and  replacing  them  with  au  a2  should 
be  correct.  Therefore,  the  new  basis  is  b \  —  au  b2  —  a2,  b3  =  b3.  The  new  basic  solution  is: 


A 

XB\ 


/ 

5 

1  I  4  -1 

2 

11 

11  [-1  3 

(3 

7 

11 

xB2  “  xBi  ~  ^l-^Bi  and  xB2  is  the  scalar  xB3  for  this  problem.  Therefore 

,5 

XB3  “  2  —  (2,2) 


11 


-2 

11 


<  0. 


Hence  Paranjape’s  method  has  led  to  an  infeasible  solution.  The  new  solution  is  a  basic  solu¬ 
tion  since: 
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\ 

g 


3 

7 

1 

2 

0 

2 

1 

+  7~ 

4 

0  = 

3 

2 

11 

2 

11 

1 

2 

but  it  is  nor  feasible. 


Blocher  [1]  gives  a  correct  analysis  of  the  two  vector  basis  entry  algorithm. 

Let  us  suppose  that  ar  and  aq  are  to  enter  the  basis  and  we  wish  to  determine  which  vec¬ 
tors  bs,  b,  should  leave  the  basis.  With  this  solution,  the  conditions  for  feasibility  are: 


(20) 


Xbs  “ 


xB-y<q  ~  xB:y,q  > 

W„  y s^y  r/i 


(21) 


xB,  “ 


XB,y>n  ~  xBsy,r  > 

y  spy  tq  ysqy,n 


(22)  xBl  -  x„,  -  0pyip  -  0qylq  >0,  /  *  s,t 

(23)  y*y«  ~  y^y>p  *  °- 

where  (23)  guarantees  that  Det(Kn)  ^  0.  Analysis  for  more  than  a  two  vector  exchange  is 
considerably  more  complicated  and  has  not  been  attempted  here. 


2.5  The  Algorithm 

Given  the  results  of  the  previous  sections  we  now  propose  a  multiple  basis  entry  algo¬ 
rithm.  We  will  restrict  attention  to  a  two  vector  exchange  and  use  (23)  to  insure  that  Theorem 
1  is  satisfied.  We  take  the  view  that  checking  (20) -(22)  to  determine  the  leaving  variables  is 
too  heavy  a  computational  burden  and  we  propose  to  move  to  the  new  basic  solution  even  if 
feasibility  is  violated.  The  use  of  a  composite  objective  function  (see  [6])  will  be  used  to  drive 
the  solution  back  to  the  feasible  region.  Furthermore,  we  will  use  the  two  vector  replacement 
for  only  a  fixed  number  of  iterations  and  then  use  only  single  replacements  thereafter,  hence 
finiteness  and  convergence  is  guaranteed  by  the  simplex  method. 


ALGORITHM-1:  MULTIPLE  BASIS  EXCHANGE  ALGORITHM 


0.  Initialization 


Let  [jc„;  vv]  be  a  basic  solution.  Save  the  objective  function,  c *  —  c,  select  /3  for  the 
composite  objective  function,  and  set  y  to  the  desired  value  for  the  maximum  number 
of  double  basis  replacement  iterations.  Set  i  —  0. 


1.  Composite  Objective 


Set  d/ 


0,  if  x,  >  0 
1,  if  x,  <  0. 


Set  c  —  c*  +  /3 d. 
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2.  Pricing 

Let  i/i  =  (jf,  nonbasic:  z -  c,  <  0|.  If  t/<  -  <t>,  terminate  with  (xa;xv]  optimal.  If 
/  <  y  and  |i/<|  >  2,  then  select  xp  and  x„  from  </»  to  enter  the  basis'  and  set  a  —  2; 
otherwise,  select  xp  from  1 1>  to  enter  the  basis  and  set  a  —  1. 

3.  Select  Leaving  Variable 

a.  If  a  =  2,  select  two  vectors,  say  6S,  6„  to  leave  the  basis;  otherwise,  go  to  c. 

b.  If  ys^y,q  -  y*,yw  ^  0,  go  to  4;  otherwise,  go  to  c. 

c.  Let  only  xp  enter  the  basis,  perform  a  simplex  pivot,  set  /«—  /  +  !  and  return  to  1. 


4.  Update 


Set  B 


| 

. +  - 1 

I  / 


B~\ 


*b\  *“  and 

*B2  *bi  —  Y 2i  Set  /'*—/  +  1  and  go  to  1. 


An  example  problem  illustrating  ALGORITHM-1  is  presented  in  Appendix  A. 

3.  A  FEASIBLE  DIRECTIONS  ALGORITHM 

For  the  algorithm  of  Section  2  we  allowed  one  (or  two)  nonbasic  variables  to  mcrease  in 
value  at  each  iteration  and  required  that  the  same  number  of  basic  variables  assume  the  new 
value  of  zero.  In  this  section  we  relax  the  requirement  that  the  nonbasic  variables  must  assume 
the  value  of  zero,  but  we  require  that  feasibility  be  maintained. 

In  developing  this  algorithm  we  have  drawn  freely  from  the  theory  of  nonlinear  program¬ 
ming  and  the  development  which  follows  is  simply  our  implementation  of  a  feasible  direction 
procedure.  Other  related  ideas  may  be  found  in  [2). 

For  generality  we  rewrite  the  linear  program  with  upper  bound  constraints  as  follows. 


subject  to  Ax  -  b  | 

0  <  x  <  u.  I 

Let  B  be  any  feasible  basis  for  (24).  Partitioning  all  other  quantities  in  (24)  into  the  basic  and 
nonbasic  components,  we  may  rewrite  (24)  as  follows. 


(25) 


max  z  -  c  BxB  +  c’vx* 
subject  to  Bxb  +  N  xN  -  b 


(26) 
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(28)  0  x,v  ^  u.v 

Solving  (26)  for  xB  and  substituting  into  (25)  and  (27)  we  obtain 
max  z  -  (c*/v  -  FbB~'H)  xv  +  FBB~'b 
subject  to  0  <  -  fl^'/Vxv  ^  uB 

0  <  Xv  ^  wv 

We  define  any  direction  in  nonbasic  space  as  a  feasible  direction  of  movement.  This  is 
because 

xH  =  B'b  -  B  '  Nxn 

may  be  used  to  determine  xB  given  any_xv.  An  improving  feasible  direction  at  a  nonbasic  point 
x®  is  any  direction  d  having  V:(x")  ■  d  >  0,  where  V:(x;?)  is  the  gradient  of  z  evaluated  at 
x°.  Since  we  are  dealing  with  a  linear  function,  Vz(x°)  =  FN  -  FbB~' N.  The  maximum 
movement  in  some  direction  d  (i.e.,  x„  +  ad)  is  restricted  by  (27)  and  (28).  Then  a  is  res¬ 
tricted  by 

(29)  B~'b  -  B~'Nxn  -  i7fl  <  B~'N  a  d  <  B  'b  -  B~1Nxn 

and 

(30)  -*N  <  a  d  <  uN  -  xs 

We  now  present  a  general  feasible  directions  algorithm  for  the  linear  program  (24). 


ALGORITHM-2:  FEASIBLE  DIRECTIONS  ALGORITHM 
0.  Initializaton 

Find  a  feasible  basis  B  with  corresponding  solution  [xfl,  xv].  Let  «  >  0  be  some  termi¬ 
nation  tolerance. 


1.  Pricing 

Select  a  direction  vector  d  such  that 


dj 


If  d  -  0,  terminate. 


1,  if  Xyy  <  uN  and  c,  —  zt  >  e. 
— 1,  if  Xf/j  >  0  and  c,  —  z,  <  «. 
0.  otherwise. 


2.  Maximum  Movement 

Find  the  largest  a,  say  a*,  such  that  (29)  and  (30)  are  satisfied. 

3.  Update  Variables 

Let 

xN  *—  xv  +  a  *d  and 
xB  4  X/f  —  /V  a  *d 
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4.  Pivot  Required 

If  a  *  is  determined  by  (30)  return  to  step  1;  otherwise,  at  least  one  basic  variable  has 
been  driven  to  either  zero  or  its  upper  bound.  Replace  this  basic  variable,  say  xB, ,  by 
some  nonbasic  variable,  say  xV/,  having  yn  ^  0  where  yr  =  B  [a,. 

Note  that  if  in  step  1  we  require  that  d  have  exactly  one  nonzero  element,  then  the  above 
algorithm  becomes  precisely  the  primal  simplex  method.  To  our  knowledge,  the  computational 
efficiency  of  this  type  of  algorithm  has  never  been  experimentally  studied.  An  example  prob¬ 
lem  has  been  solved  using  ALGORITHM-2  in  Appendix  B. 


APPENDIX  A 

Example  Using  ALGORITHM-1 

Consider  the  following  example 


max  X| 

+  x2 

max  X) 

+  x2 

s.t.  2x| 

+  3x2 

< 

6 

s.t.  2x, 

+  3x2  +  X3 

- 

6 

X] 

-  2x2 

< 

1 

X 1 

-  2x2 

+  x4 

= 

1 

X\ 

2 

*i 

+  *5 

2 

X\, 

x2  > 

0 

x2>  xh 

x4,  x5 

> 

0 

0.  (Initialization) 

Let  |xjv  x'2  xf  xf  xfj 
Set  c*  =  [1  1  0  0  0],  /3 

1.  (Composite  Objective) 

d  =  [0  0  0  0  0]  and  c  —  [1  1  0  0  0] 


=  (0  0  6  1  5). 

=  2,  y  =  1,  /  -  0. 


2.  (Pricing) 


X|t  —  C|  =  — 1  X|  {  ijl 

x2:  ^ 2  —  c2  =  —  1  =#•  X2  e  t h 

Let  xp  =  X|,  xq  =  x2,  and  a  =  2. 


3.  (Select  Leaving  Variable) 

fl  0 

Let  [ bs ,  b, ]  = 


0  1 
0  0 


s  t 
2  31" 

1  -2  Jr/ 


Then 


and  y,nyh,  -  y,qylp 


(2)  (-2)  -  (1)  (3)  =  -7 
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4.  (Update) 


v-\  * 
'll 

2/7  3/7 

1/7  -2/7 

and 

Kj,  -  11  0], 

B~'  - 

2/7  3/7 
1/7  -2/7 

1 

1  - 

2/7  3/7  0 

1/7  -2/7  0 

-2/7  -3/7 

1 

lj 

-2/7  -3/7  1 

[x,l  2/7  3/7  tal  _  15/7 

Xb[  ~  x2  ~  1/7  -2/7  1  ~  4/7 

xB2  =  *5  =  2  -  [2/7  3/7]  J  =  -1/7. 

/  =  2. 

1.  (Composite  Objective)  [xf  xf  x3v  xf  xf]  =  [15/7  4/7  0  0  -1/7] 

d  -  [0  0  0  0  1]  and  c  —  [1  1  0  0  2]. 

2.  (Pricing) 

x3:  z3  -  c3 - 1/7  »x3«i) 

X|t  z4  —  c4  =  —5/7  x4  «  «/» 

Let  xp  =  x4  and  a  =  1 . 

3.  (Select  Leaving  Variable) 

Leaving  variable  is  x5 

0  0  1 
fi-'  -  1/3  0  -2/3 
2/3  1  -7/3 

[xf  xf  xf  xf  xs*]  =  [2  2/3  0  1/3  0] 

1.  (Composite  Objective) 

d-0,  c  -  [1  10  0  0] 

2  (Pricing) 

x3:  z3  —  c3  —  1/3 
x<:  z4  —  f'  ’  1/3 

♦  Optimality! 


•  guenie  of  pivots  is  illustrated  in  Figure  1. 
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APPENDIX  B  Example  Using  ALGORITHM-2 

Consider  the  following  example 
max  X|  +  x2  max  x,  +  x2 

s.r.  2x|  +  3x2  <  6  s.t.  2x,  +  3x2  +  x3  —  6 
x,  -  2x2  ^  1  — *  x,  -  2x2  +  x4  -  1 

0  <  x,  <  2  0  <  x,  <  2, 

0  <  X2  <  0  <  X2,  X3,  x4  ^ 

0.  (Initialization) 

Let  Ixf'  x2  xf  x®  ]  =  [0  0  6  1],  and  «  =  0. 

1.  (Pricing) 

C\  ~  Z\  -  1.  ^2  ~  *2  -  1- 


2.  (Maximum  Movement) 
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3.  (Update  Variables) 

x,  =  0  +  (6/5)  (1)  =  6/5 
x2  =-  0  +  (6/5)  (1)  -  6/5 
x3  -  6  -  (5)  (6/5)  =  0 
x4  =1  -  (-1)  (6/5)  -  11/5 

4.  (Pivot) 

[2  0 


Then  B~'  = 


1/2  0 
-1/2  1 


1.  (Pricing) 

[xf  x‘i  x3v  xfl  =  [  6/5  6/5  0  11/5] 
c2  -  z2  =  1  -  3/2  -  -  1/2 
cj  -  z3  -  0  —  1/2  -  -  1/2 

_  f-ll 


2.  (Maximum  Movement) 


9/5 

-21/5 


2 

OO 


-3/2 

7/2 


a  < 


3 

2 


and 


-6/5 

0 


3.  (Update  Variables) 

x  2  =  6/5  +  8/ 1 5( — 1)  =  2/3 
x3  -  0  +  (8/15)  (0)  =  0 
x,  =  6/5  -  (8/15)  (-3/2)  -  2 
x4  -  11/5  -  (8/15)  (7/2)  -  1/3 


4.  (Pivot) 


3  0  1 

1/3  0 

Let  B  - 

-2.) 

2/3  1 

1.  (Pricing) 


c,  -  r,  -  1  -  2/3  -  1/3 
c}  —  z3  -  0  —  1/3 - 1/3 


Terminate! 


9/5 

-21/5 


The  solution  sequence  is  illustrated  in  Figure  2. 
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V2 


ITERATION  -1 


KlGURE  2  Example  problem  solution  by  ALGORITHM-2 
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DESIGN  OF  A  PROCESS  CONTROL  SCHEME  FOR 
DEFECTS  PER  100  UNITS  BASED  ON  AOQL* 


Richard  S.  Leavenworth  and  Richard  L.  Scheafler 

University  oj  Florida 
Gainesulle,  Florida 

ABSTRACT 

A  process  control  scheme  is  developed  in  which  decisions  as  to  the  frequen¬ 
cy  of  sampling  arc  made  based  upon  the  choice  of  an  Average  Outgoing  Quality 
Limit.  The  scheme  utilizes  plotted  points  on  a  U-control  chart  for  defects  and 
the  theory  of  runs  to  determine  when  to  switch  among  Reduced.  Normal. 
Tightened,  and  100  percent  inspection  The  scheme  is  formulated  as  a  semi- 
Markov  process  to  derive  steady  state  equations  for  the  probabilities  of  being  in 
Reduced,  Normal.  Tightened,  or  100  percent  inspection  and  for  Average  Out¬ 
going  Quality  and  Average  Fraction  Inspected  The  resulting  system  and  the 
computer  programs  used  to  derive  it  are  discussed 


INTRODUCTION 

In  current  process  control  an  important  question  that  still  appears  not  to  have  found  an 
adequate  answer  is  "How  much  inspection  is  enough  inspection?"  Standard  texts  in  process 
quality  control  tend  to  sidestep  this  issue.  Frequently  examples  are  given  in  which  control 
charting  inspection  data  is  acquired  in  subgroups  under  100  percent  inspection.  This  is  more 
likely  to  be  the  case  during  new  process  start-up.  Other  examples,  usually  cases  of  continued 
use  of  control  charts,  indicate  some  form  of  sampling.  Seldom  is  there  mention  made  of  the 
decision  process  that  determines  at  what  point  a  change  is  made  from  one  procedure  to  the 
other. 

In  more  recent  years  research  on  process  control  methodologies  has  turned  to  cost-based 
economic  models  (frequently  based  on  some  Bayesian  notions  about  physical  operation  of  the 
process)  to  help  provide  an  analytical  framework  within  which  to  answer  this  most  important 
question  of  resource  justification  and  allocation.  To  mention  only  two  such  developments  in 
the  area  of  process  control,  Duncan  (2),  proposed  an  economic  design  for  the  X  chart  in  1956, 
and  Montgomery,  Heikes,  and  Mance  [7]  proposed  a  p-chart  model  in  1975. 

For  one  reason  or  another,  there  is  little  indication  in  the  literature  that  these  models 
have  found  application  in  industry.  Nor  do  they  appear  to  have  been  picked  up  by  any  of  the 
standard  texts  in  process  quality  control. 


'This  research  was  supporicd  by  ihc  U  S  Department  of  the  Navy.  Office  of  Naval  Research  under  Contracts  Number 
N 000 1 4-68- A-0 1 73-002 1  and  N000I4-75-C-0783. 


463 


464 


R.S.  LEAVENWORTH  AND  R.L.  SCHEAFFER 


The  interest  of  the  authors  in  this  question  was  stimulated  when  they  were  contacted  by 
quality  control  representatives  from  a  large  aircraft  maintenance  facility.  Without  the  manufac¬ 
turing  activity,  the  usual  continuous  production  lines  and/or  job  shop  operation  producing 
batches  of  essentially  identical  items  did  not  exist.  Thus,  a  reasonable  approach  seemed  to  be 
to  attempt  to  control  maintenance  operations  on  the  basis  of  mistakes  made  per  100  man-hours 
worked  rather  than  on  the  basis  of  percent  defective  items. 

The  general  approach  to  the  problem  chosen  by  the  authors  was  to  adapt  the  concept  of 
Acceptance  Control  Charting,  developed  by  Freund  13],  and  the  AOQL  concept  from  accep¬ 
tance  sampling,  developed  by  Dodge  [1],  to  the  basic  u-chart  model.  Freund  based  his  X  chart 
model  on  the  selection  of  two  points  on  the  (OC)  Operating  Characteristic  Curve,  the  Accept¬ 
able  Process  Level  (APL),  with  Type  I  error  probability  a.  and  a  Rejectable  Process  Level 
(RPL),  with  Type  II  error  probability  j3.  Solution  of  the  model  yields  a  sample  subgroup  size 
and  a  one-sided  control  limit.  The  Freund  formulation,  however,  does  not  yield  an  analytical 
solution  to  the  question,  "How  much  inspection  is  enough  inspection?" 

First  developed  for  lot-by-lot  acceptance  sampling  by  attributes  and  later  used  as  the  foun¬ 
dation  of  continuous  sampling.  Dodge’s  AOQL  concept  of  rectifying  inspection  is  based  on 
alternating  back  and  forth  from  100%  inspection  to  sampling  inspection.  Thus,  over  the  long 
haul,  the  average  quality  will  be  a  mix  of  product,  part  of  which  is  some  proportion  defective 
and  part  of  which  is  (presumably)  perfect.  It  is  precisely  this  aspect  of  rectifying  inspection  that 
the  authors  chose  as  the  analytical  base  upon  which  to  answer  the  "How  much"  question. 

APPLICATION 

Interest  in  attacking  the  problem  of  in-process  inspection  was  originally  stimulated  by  a 
perceived  need  on  the  part  of  a  large  aircraft  maintenance  facility.  Therefore,  many  of  the  sys¬ 
tem  design  assumptions,  development,  and  basic  formulations  that  follow  are  based  on  the 
specific  needs  and  operating  methods  of  that  organization. 

The  organization  was  familiar  with  acceptance  sampling  procedures  and  in  particular  those 
of  MIL-STD-105D  [6]  and  Handbook  H-I06  on  multi-level  continuous  sampling.  Sampling 
inspection  was  used  in  shops  processing  non-critical  items.  Sample  sizes,  applicable  on  a 
monthly  basis,  were  selected  based  on  a  modification  of  MIL-STD-105D.  However,  defective 
items  found  in  excess  of  the  MIL-STD-105D  acceptance  numbers  led  to  no  positive  action 
because  there  was  no  formed  lot  upon  which  action  could  be  taken. 

The  basic  inspection  unit  used  in  this  process  control  scheme  is  the  manhour  of  produc¬ 
tive  work.  Sampling  is  based  on  inspecting  units  of  output  and  recording  the  time  required  to 
complete  the  work  and  the  number  of  defects  found.  The  time  span  during  which  a  sample  of 
some  proportion  of  the  total  manhours  worked  will  be  drawn,  if  the  shop  is  not  on  100% 
inspection,  is  called  a  Production  Interval.  In  the  theoretical  developments  that  follow,  it  is 
assumed  that  the  inspection  process  never  passes  over  a  defect.  That  is,  when  100%  inspection 
is  in  force,  all  defects  are  intercepted  and  repaired  or  replaced,  and  that  defects  found  in  sam¬ 
ples  also  are  intercepted. 

In  describing  the  various  aspects  of  this  study,  we  have  adopted  the  terminology  used  by 
Hill  [5]  and  expanded  upon  by  Stephens  and  Larson  [9].  The  term  sampling  scheme  refers  to 
"an  over-all  strategy  specifying  the  way  in  which  sampling  plans  are  to  be  used."  Under  this 
definition,  MIL-STD-105D  is  an  AQL  (Acceptable  Quality  Level)  scheme;  discussed  herein  is  a 
combination  AQL- AOQL  (Average  Outgoing  Quality  Limit)  scheme.  The  term  sampling  plan 
is  used  to  describe  "the  specification  of  the  rules  to  be  followed  in  sentencing  any  particular 


PROCESS  CONTROL  BASED  ON  AOQL 


465 


batch  of  articles,"  or,  in  this  case,  sentencing  the  process  itself.  The  term  sampling  system 
refers  to  the  group  of  sampling  plans  and  the  switching  rules  used  to  determine  when  to  switch 
from  one  plan  to  another  and  to  and  from  100%  inspection. 

Ground  Rules  for  Sampling  Scheme 

The  basic  ground  rules  under  which  the  procedure  was  developed,  largely  established 
because  of  the  company  organization’s  familiarity  with  MIL-STD-10SD,  were  as  follows: 

(1)  The  concept  of  AQL,  established  and  long  accepted  in  government  standards  and 
specifications,  would  be  maintained.  The  AQL  is  one  basis  for  coding  the  various  sam¬ 
pling  plans  in  the  inspection  scheme. 

(2)  Production  Interval  ranges,  in  terms  of  man-hours  worked  during  a  fixed  period  of  time, 
and  standard  AQL  values  would  increase  in  a  geometric  pattern  in  accordance  with  the 
procedures  employed  to  set  preferred  AQL  values  in  MIL-STD-105D,  roughly  multiples 
of  10° 2. 

(3)  Provisions  for  normal,  tightened,  and  reduced  inspection  would  be  included  as  well  as 
provisions  for  100%  inspection.  It  is  the  provision  for  100%  inspection  that  allows  calcula¬ 
tion  of  an  AOQL. 

(4)  Emphasis  was  to  be  on  process  control;  therefore,  decision  rules  focus  on  control  charting 
techniques. 

(5)  Procedures  would  need  to  be  simple  and  straight-forward  and  require  as  little  calculation 
as  possible. 

(6)  AOQ  (Average  Outgoing  Quality)  functions  were  to  be  provided.  When  rectifying  inspec¬ 
tion  is  employed,  the  AOQL  provides  a  measure  of  the  level  of  protection  to  the  custo¬ 
mer.  The  scheme  was  to  be  coded  against  the  AOQL  as  well  as  the  AQL. 

(7)  Shop  history  of  defects,  AQL  levels,  and  man-hour  levels  determine  the  amount  of 
inspection  required.  API  (Average  Fraction  Inspected)  curves  were  to  be  provided  in 
order  to  assist  management  in  projecting  required  inspection  manpower  levels. 

Measures  of  Effectiveness 

The  measures  of  effectiveness  considered  for  the  scheme  included  the  Average  Outgoing 
Quality  Limit  and  the  Average  Fraction  Inspected  (AFT).  The  scheme  is  coded  against  an  AQL 
and  an  AOQL  in  which  three  different  levels  of  inspection  are  provided  dependent  upon 
management’s  requirement.  They  are  designated  Inspection  Levels  I,  II,  and  III,  in  order  of 
increasing  stringency,  respectively.  In  each  case: 

AOQL  -  AQL  (10°  2‘) 
where  y  =  2,  for  Inspection  Level  I 
1,  for  Inspection  Level  II 
0,  for  Inspection  Level  III 

(AOQL  =  AQL  for  all  sampling  systems  designated  under  Inspection  Level  III). 

This  relationship  was  chosen  for  reasons  of  practicality  and  convenience.  The  theory  would 
work  with  any  prescribed  relationship. 
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AN,  defined  as  the  proportion  of  the  productive  man-hours  subjected  to  inspection,  was 
chosen  as  the  objective  function  to  be  minimized.  This  measure  is  converted  into  an  average 
number  of  items  checked  by  the  Q.  C.  specialist  based  on  the  number  of  man-hours  worked  in 
a  shop  during  a  designated  Production  Interval  and  the  number  of  items  processed  during  the 
period.  During  any  given  Production  Interval,  actual  hours  included  in  a  sample  may  vary  from 
the  planned  amount. 

Since  API  ranges  from  the  proportion  of  hours  inspected  under  reduced  inspection  to  1, 
when  consistently  on  100  percent  inspection,  it  is  necessary  to  identify  some  specific  value  of 
production  quality  at  which  the  API  is  to  be  minimized.  The  point  chosen  was  the  AQL,  that 
rate  of  defect  production  considered  to  be  the  maximum  allowable  as  a  process  average. 

SYSTEM  DESCRIPTION 

SOME  DEFINITIONS 

Definitions  of  terms  and  symbols  required  for  discussion  of  the  rectifying  inspection  sys¬ 
tem  follow. 

AFI  =  Average  Fraction  Inspected.  The  proportion  of  total  production  of  a 
shop  which  will  be  inspected,  on  the  average,  when  the  rate  of  defects 
is  at  a  stipulated  level. 

AOQ  —  Average  Outgoing  Quality.  The  average  quality  of  outgoing  production  in  defects 

per  100  man-hours  when  the  rules  and  procedures  of  the  sampling  system  are  applied. 

AOQL  =  Average  Outgoing  Quality  Limit.  The  maximum  value  that  average 

outgoing  quality,  in  defects  per  100  man-hours,  will  reach  when  the  rules  and 
procedures  of  the  sampling  system  are  applied. 

AQL  =  Acceptable  Quality  Level.  The  maximum  rate  of  defect  production, 
in  defects  per  100  man-hours,  which,  for  purposes  of  sampling 
inspection,  can  be  considered  acceptable  as  a  process  average. 

CL  =  Control  Limit  (Upper)  for  a  Shop  Control  Chart  for  defects  per  100  man-hours. 

CL,  =  Control  Limit  under  reduced  sampling  inspection. 

CL„  =  Control  Limit  under  normal  sampling  inspection  and  under  100%  inspection. 

CL,  =  Control  Limit  under  tightened  sampling  inspection. 

H  =  Production  Interval.  The  number  of  shop  production  man-hours  worked  during 

a  pre-determined  period  of  time  such  as  a  day,  a  week,  or  a  month.  In  normal 
practice  the  week  is  chosen  as  the  Production  Interval. 

h„  =  Number  of  man-hours  of  production  to  be  included  in  the  sample  during 
one  production  interval  on  the  normal  sampling  inspection.  The  fraction 
of  productive  time  is  given  by  f„  -  h„/H.  During  100  percent 
inspection,  inspection  results  are  accumulated  in  subgroups  of  /;„  hours. 

hr  —  Number  of  man-hours  of  production  to  be  included  in  the  sample  during 
one  production  interval  when  on  the  reduced  sampling 
inspection.  The  fraction  of  productive  time  is  given  by  f,  -  liJH. 
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ht  =  Number  of  man-hours  of  production  to  be  included  in  the  sample  during 
one  production  interval  when  on  the  tightened  sampling  inspection. 

The  fraction  of  productive  time  is  given  by  /,  =  hj H 


Sampling  System  Design 


The  generalized  form  of  the  sampling  system  is  shown  in  Figure  I.  The  parameters  which 
were  varied  for  analytical  purposes  include. 

(1)  The  sampling  rates  /„,  /,,  and  /,. 

(2)  The  run  lengths  required  to  produce  a  switch  among  reduced,  normal,  tightened,  and  100 
percent  inspection.  These  are  designated  A,,  k2.  k 3,  A4,  and  As. 


Figure  1  Flow  chan  of  generalized  sampling  system 
used  lor  analysis 


Thus  the  system  provides  for  three  different  sampling  intensities.  Formal  rules  are  pro¬ 
vided  for  switching  from  one  to  another  and  to  and  from  100  percent  inspection.  When  on  100 
percent  inspection,  inspection  data  are  accumulated  into  subgroups  of  h„  man-hours  for  control 
charting  purposes  and  for  the  purpose  of  determining  the  time  at  which  to  return  to  sampling 
inspection.  All  decisions  are  based  on  the  interpretation  of  inspection  data  points  on  a  shop 
control  chart. 


A  general  system  flow  diagram  is  shown  in  Figure  2. 
the  probability  transition  matrix  shown  in  Figure  3. 


This  diagram  was  used  to  develop 


Entering  States 
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Slate  Transition  Probabilities  Defined 

The  following  notation  has  been  used  to  define  the  transition  probabilities  of  Figure  3: 

Inspection  States 


Reduced 

Normal 

Tightened 

Probability  of  a  sample  point 
below  the  AQL  central  line  on 
the  control  chart. 

Pi(r) 

p,(n) 

PiO) 

Probability  of  a  point  between 
the  AQL  and  the  CL. 

Pi,(r) 

p,,(n) 

PiA') 

Probability  of  a  point  above  CL. 

Pj(r) 

p,/(n) 

pA<) 

/>(</)  =  probability  of  a  point  below  the  CL  (in  control)  on  the  control  chart  when  on 

1 00°/.  inspection  (detailing). 

=  P/(n)  +  Pi,(h) 

1  -  p(cl)=  probability  of  a  point  above  the  CL  (out  of  control)  when  on  100% 
inspection. 

Formulation  of  Operating  Characteristics  of  the  System  Model 

The  theoretical  basis  for  developing  formulas  for  the  operating  characteristics  of  the  sam¬ 
pling  system  is  given  in  Appendix  A.  The  system  model  of  Figures  1  and  2  was  formulated  as 
a  semi-Markov  process.  Steady  state  probabilities  of  being  in  Reduced  P(R)\  Normal,  PGV): 
Tightened  PCD;  and  Detailing,  P(D);  inspection  were  formulated  in  general  from  the  proba¬ 
bility  •  ansition  matrix.  Figure  3.  These  equations  are  given  in  Appendix  B. 

Operating  Characteristic  Curves  were  developed  from  the  steady-state  time-weighted  pro¬ 
babilities.  /*'(■),  of  being  in  the  various  inspection  states  R,  N,  T.  and  D,  given  that  the  process 
is  operating  in  control  at  specified  levels  of  0,  the  parametric  rate  of  defects  resulting  per  100 
man-hours  worked.  These  are  the  likelihood  functions,  L(6),  or  equivalently,  the  trace  of 
P'()  as  the  parameter  ft  is  varied  from  0  over  its  effective  range.1 

The  time-weighted  steady-state  probabilities  of  being  in  the  various  slates  were  then  used 
in  the  equations  for  the  measures  of  system  effectiveness,  AFI  and  AOQ. 

From  Appendix  A,  the  development  of  equation  A. 5  yielded: 

m  P(R) _ umi _ tm _ 

(1)  h„P(D)  +  H[\  -  P(D)]  f„P(D)  +  [1  -  P(D)]  ' 

Corresponding  equations  for  states  /V  and  T  are  equivalent  to  (1)  with  R  replaced  by  N 
and  T,  respectively.  For  the  detailing  state,  D , 

'This  is  consistent  with  the  binominal  assumption  used  in  producing  the  O.C.  Curves  lor  the  various  sampling  plans 
contained  in  MIL-STD-I05D  [61  wherein  it  is  assumed  that  the  incoming  fraction  defective,  p.  is  constant  and  results 
from  a  process  operating  in  control  at  the  level  p.  The  O.C.  Curves,  then,  are  likelihood  functions.  Up),  resulting 
from  the  trace  of  the  probability  of  acceptance  of  a  given  lot  as  p  is  varied  from  0  over  its  effective  range  ( <  I).  The 
same  assumption  was  employed  by  Stephens  and  (.arson  |9|  in  their  analysis  of  ihe  operation  of  MIL-STD-I05D  as  an 
acceptance  sampling  system 
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(2) 


P(D) 


f„PiD) 

f„P(D)  +  (1  -  P(D )] 


The  equation  for  Average  Fraction  Inspected  also  is  derived  in  Appendix  A,  equation  A. 4. 
By  eliminating  //from  this  equation,  we  obtain: 

AFI  =  [f„P(D)  +  (1  -  /’(D))]"1  lfrP(R)  +f,P(T)  +  f„{P(D)  +  P(N)}} 

which  may  also  be  expressed  as: 

(3)  AFI  =  frP'(R)  +f„P'(N)  +  f,P'(  T)  +  P‘(D) 


Since  the  time-weighted  steady-state  probabilities  are  required  to  produce  the  O.C 
Curves,  this  latter  form  of  the  equation  is  more  useful. 

The  AOQ  function  is  obtained  from: 

(4)  AOQ  =  0(1  -  AFI) 


Calculation  of  Zone  Probabilities 

Use  of  the  control  statistic  "defects  per  100  man-hours"  suggest  a  Poisson  distribution  of 
defects  over  time  and  the  use  of  the  U-chart  for  control  charting  purposes.  The  zones  of 
interest  on  the  U-chart,  as  previously  defined,  are: 

1.  The  area  between  U  equals  0  and  U  equals  the  AQL  {/>/(•)}. 

2.  The  area  between  U  equals  the  AQL  and  U  equals  CL,  the  control  limit  {/>/,(•)). 

3.  The  area  beyond  U  equals  the  (upper)  control  limit  {/>,/(•))■ 

The  transition  probabilities  correspond  to  likelihoods  of  observing  values  of  the  control 
statistic  (U)  in  different  zones  on  the  control  chart.  The  physical  characteristics  of  zones  on  the 
chart  are  dependent  on  the  selection  of  AQL,  a  control  limit  specification,  a  set  of  sampling 
intensities  when  on  sampling  inspection,  and  a  subgroup  size  when  on  detailing  inspection. 
Once  the  physical  characteristics  of  the  zones  are  quantified  in  terms  of  critical  numbers  of 
defects,  transition  probabilities  can  be  easily  calculated  for  any  assumed  incoming  defect  rate 
based  on  the  Poisson  distribution. 

Calculation  of  Transition  Probabilities 

For  any  value  of  the  process  parameter,  ft,  the  transition  probabilities  are  given  by: 


(5) 


P,(x)  - 


,V(.vl 

I 


/-  n 


(ft  •  /i,)' 

- : - t> 


(6) 


p„(x)  - 


DMAX<*’  (ft  •  /,()' 

I  — y-e 

,-.V(  v)  +  l  J  • 


1 
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and 

(7)  pAx)  =  1  ~  -  pjx) 

for  x  =  n,  r.  t.  and  where  A'(.v)  and  DMAX(.v)  are  defined  as  follows: 


(8) 


Nix) 


max  |A 


AQL  hx 

Too-- 


^  A;  A  =  0.1,... 


(9) 


DMAX(a)  =  Max 


d 

✓/IV 

AQL 

Too' 

•  hy 

1 

i  AQL 

/~0 

/'! 

_exp|  100 

.99;  d  =  0,  1, 


where  .v  =  n,  r.  /.  Thus,  when  lhe  number  of  defects  found  is  less  than  or  equal  to  A'(.v),  the 
point  plot  will  always  be  in  the  control  chart  zone  between  0  and  the  AQL.  In  terms  of  the 
physical  characteristics  of  the  control  chart: 


(10) 


CL,  = 


DM  AX  (.v)  +  0.5 


■  100  (for  U  in  defects/ 100MH) 


The  factor  0.5  is  included  so  that  points  will  fall  above  or  below  the  CL  and  never  on  it. 


It  should  be  noted  that  the  values  of  the  control  limit,  CL(,  are  based  on  standard  sample 
sizes  in  hours  and  on  standard  values  of  the  central  line,  the  AQL.  Thus  the  control  chart  test 
is  whether  or  not  the  process,  or  shop,  is  operating  at  or  below  the  designated  AQL. 

It  is  quite  possible  for  a  shop  to  be  operating  in  a  state  of  statistical  ccntrol.  but  at  a  qual¬ 
ity  level  above  the  AQL,  with  the  result  that  values  of  Uw ill  fall  above  CL,  with  high  probabil¬ 
ity  and  thus  signal  a  lack  of  control.  Correspondingly  it  is  possible  for  a  shop  to  be  technically 
out  of  statistical  control  at  quality  levels  significantly  below  the  AQL  with  the  result  of  no  signal 
of  lack  of  control.  This  simply  illustrates  the  difference  between  a  standard  control  chart  based 
on  a  "best  estimate"  of  the  actual  process  level  and  an  Acceptance  Control  Chart  based  on  a 
standard  or  aimed-at  value  of  the  control  statistic. 


JYSTEM  development 

Initial  System  Characteristics  Model 

A  set  of  FORTRAN  programs  was  developed  which  included  calculation  of  state  transition 
probabilities,  steady  state  Markov  chain  probabilities,  the  time-weighted  system  probabilities 
(P'(x),  x  =  R,  N,  T,  D),  and  the  AFI  and  AOQ  values  for  appropriate  ranges  of  the  defect 
rate  parameter,  9.  A  Dow  diagram  of  the  operation  of  this  routine  is  shown  in  Figure  4.  A 
sample  of  the  graphical  output,  using  a  CALCOM  plotter,  is  shown  in  Figure  5. 

Initially,  the  output  of  this  program  set,  coupled  with  printed  data  listing  values  of  the 
AFI  at  9  equals  the  AQL,  the  value  of  9  at  which  the  AOQ  function  reaches  its  maximum,  the 
sample  hours  under  Normal  inspection  ( /;„) ,  and  the  highest  count  of  defects  that  lies  within 
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0  Mol 

Figure  5.  Sample  operating  characteristic  curves 

each  zone  of  the  control  chart,  (.N(x)  and  DMAX(x)),  were  used  to  test  input  system  parame¬ 
ters.  Ultimately,  this  program  set  was  used  to  generate  the  Operating  Characteristic  Curves  for 
the  scheme  developed  for  the  company. 

AQL  and  Production  Interval  Progressions 

Following  the  practice  generally  employed  in  Military  Standards,  preferred  AQL  values 
were  established  based  on  a  geometric  progression  in  multiples  of  1002.  This  provides  five 
geometrically  spaced  values  in  each  decade  interval.  Rounding  of  the  exact  geometric  values  is 
indicated  in  all  table  headings.  However,  exact  values  were  used  in  all  calculations.  Sample 
Tables  for  Inspection  Level  II  are  shown  in  Tables  I,  II,  and  III. 

The  same  pattern  was  used  in  determining  Production  Intervals,  for  which  H  varies  from 
100  to  10,000  man-hours.  Production  Interval  ranges  are  set  at  the  geometric  mid-points 
between  the  exact  values  used  in  all  calculations.  Thus  any  specific  sampling  system  chosen  is 
only  precise  when  the  value  of  the  AQL  and  the  Production  Interval  are  exact  powers  of  10° 2. 

Since  h„,  the  sample  hours  under  Normal  inspection,  constitutes  the  base  from  which  hr 
and  h,  are  derived,  h„  was  fixed  as  the  subgroup  size  to  be  used  on  detailing  inspection. 

Fixing  AQL-AOQL  Relationship 

For  the  scheme  to  be  fully  operational  in  a  wide  range  of  circumstances,  it  was  decided 
that  there  should  be  a  fixed  relationship  between  designated  AQL  values  and  their  related 
AOQL  values.  If  values  of  the  two  are  required  to  be  identical,  sample  sizes,  in  general,  will  be 
driven  unreasonably  high.  Therefore,  it  was  decided  to  designate  a  relative  one-step  difference 
wherein  all  sampling  systems  for  a  specified  AQL  have  a  AOQL  equal  to  1002  AQL.  This  sys¬ 
tem  is  designated  Inspection  Level  II,  and  was  recommended  to  the  company  for  general  use. 
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Both  tighter  (AOQL  equal  to  AQL)  and  looser  (AOQL  equal  to  10°4  AQL)  systems  are  pro¬ 
vided.  These  are  designated  Inspection  Levels  III  and  I,  respectively.  Tables  I,  II,  and  HI  give 
the  Sample  Hours,  Control  Limits,  and  AF1  values  evaluated  at  the  AQL,  respectively,  for 
Inspection  Level  II. 


TABLE  1.  Sample  Hours  in  Man-Hours  of  Production 
Under  Reduced  (//,),  Normal  (//„),  and  Tightened  (//,)  Inspection. 
Inspection  Level  II. 


Production 

Interval 

(Man-Hours) 

0.40 

Acceptable  Quality  Level  (AQL) 
in  Defects  per  100  Man-Hours 

0.65  1.0  1.5  2.5  4.0 

6.5 

10.0 

0-125 

Hr 

. 

mm 

■fH 

42 

3.0 

(1) 

Hn 

10.4 

mi 

Ht 

m  1 1 

m 

16.6 

■m 

126-200 

Hr 

7.9 

6.6 

mm 

pa 

(2) 

Hn 

i 

l 

l 

1 

19.8 

16.6 

EZ3 

Ht 

31.4 

26.2 

EH 

mm 

201-315  • 

Hr 

1 1  ■ 

Hj 

mm 

12.5 

10.4 

7.5 

6.8 

6.2 

(3) 

Hn 

.i  1 

31.4 

26.2 

18.9 

17.1 

15.6 

Ht 

1 1 

49.8 

41.6 

29.9 

27.1 

24.7 

316-500 

Hr 

19.8 

16.6 

11.9 

10.8 

9.8 

■a 

(4) 

Hn 

i 

i 

49.8 

41.6 

29.9 

27.1 

24.7 

EZ3 

Ht 

79.0 

65.9 

47.4 

42.9 

39.2 

EH 

501-800 

Hr 

MZM 

26.2 

BH 

17.1 

15.6 

12.6 

9.9 

(5) 

Hn 

i 

EZ3 

65.9 

HQ 

42.9 

39.2 

31.7 

24.9 

Ht 

19 

104 

mm 

68.0 

62.1 

50.2 

39.4 

801-1,250 

Hr 

KH 

wn 

29.9 

27.1 

24.7 

20.0 

■TOM 

11.2 

(6) 

Hn 

PB 

mSm 

75.1 

62.1 

50.2 

fills 

28.0 

Ht 

ESI 

19 

119 

98.4 

79.5 

pfis 

44.4 

1,251-2,000 

Hr 

65.9 

EQ 

42.9 

39.2 

31.7 

24.9 

17.7 

14.8 

(7) 

Hn 

166 

pi 

98.4 

79.5 

62.4 

44.4 

37.2 

Ht 

262 

19 

171 

156 

126 

99.0 

70.4 

58.9 

2,001-3,160 

Hr 

75.1 

■H 

mm 

50.2 

pa 

28.0 

23.5 

wmm 

(8) 

Hn 

189 

Eh 

156 

126 

70.4 

58.9 

Bil 

Ht 

299 

19 

247 

200 

lull 

112 

93.4 

76.5 

3,161-5,000 

Hr 

108 

98.4 

pa 

62.4 

RQ 

37.2 

30.5 

21.9 

(9) 

Hn 

271 

247 

157 

8  1 

93.4 

76.5 

55.1 

Ht 

430 

392 

tun i 

249 

Kta 

148 

121 

87.3 

5,001-8,000 

Hr 

156 

126 

PB 

58.9 

mm 

34.8 

25.2 

(10) 

Hn 

392 

317 

249 

148 

EOS 

84.3 

63.2 

Ht 

621 

502 

E 2* 

19 

235 

19 

138 

100 

Hr 

200 

■TOM 

112 

93.4 

76.5 

28.5 

(11) 

Hn 

502 

EHE 

280 

235 

192 

138 

100 

71.5 

Ht 

795 

E9 

444 

372 

305 

219 

159 

113 

0.65 

1.0 

1.5 

4.0 

6.5 

10.0 

15.0 

Average  Outgoing  Quality  Limit  (AOQL) 

in  Defects  per  100  Man-Hours 

|  Proceed  in  direction  of  arrow  until  first  plan  is  encountered. 
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TABLE  II  —  Control  Limits  under  Reduced  (CLr),  Normal  (CLn) 
and  Tightened  (C'Lt)  Inspection  in  Defects  per  101)  Man-Hours. 
Inspection  Level  II. 


Production  Acceptable  Quality  Level  (AQL) 

Interval  in  Defects  per  100  Man-Hours 


(Man-Hours) 

0.40 

0.65 

1.0 

1.5 

2.5 

4.0 

6.5 

10.0 

CLr 

■I 

as 

IK 

30.0 

50.0 

0-125 

CLn 

19 

1 

20.0 

24.0 

33.0 

CLt 

HI 

II 

II 

1  1 

12.5 

30.0 

CLr 

mm 

■ 

n 

19.0 

23.0 

32.0 

126-200 

CLn 

| 

12.5 

15.0 

21.0 

lia 

CLt 

HI 

■1 

8.0 

13.5 

18.5 

26.0 

CLr 

12.0 

14.5 

20.0 

22.0 

EZ1 

201-315 

CLn 

■i 

H 

8.0 

9.5 

13.5 

20.5 

ESI 

CLt 

■ 

■ 

5.0 

8.5 

12.0 

16.5 

HI 

CLr 

n 

7.5 

9.0 

IE11 

B9 

25.5 

Bn 

316-500 

CLn 

5.0 

6.0 

8.5 

IIS 

18.0 

CLt 

II 

3.0 

5.5 

7.5 

16.5 

24.0 

CLr 

4.5 

5.5 

8.0 

8.5 

wm 

K m 

35.0 

501-800 

CLn 

3.0 

4.0 

5.5 

8.0 

HU 

Hi 

26.0 

CLt 

2.0 

3.5 

4.5 

6.5 

EH 

HI 

22.0 

CLr 

3.0 

3.5 

5.0 

10.0 

12.5 

22.0 

801-1,250 

CLn 

2.0 

2.5 

3.5 

7.0 

11.0 

16.5 

HI 

CLt 

1.3 

2.0 

3.0 

4.0 

6.5 

9.5 

13.5 

Hi 

139 

2.5 

3.0 

3.5 

■9 

BSI 

20.0 

Em 

1,251-2,000 

1.5 

2.0 

3.5 

SSS 

eh 

14.5 

HI 

HI 

1.3 

1.8 

2.5 

4.0 

6.0 

m 

13.5 

HI 

CLr 

2.0 

2.5 

4.0 

5.0 

9.0 

12.5 

29.0 

2,001-3,160 

CLn 

1.5 

2.0 

3.0 

4.5 

6.5 

9.0 

EH 

22.0 

CLt 

1.2 

1.6 

2.5 

3.8 

5.5 

8.5 

EH 

19.0 

CLr 

1.5 

2.5 

3.0 

5.5 

8.0 

wm 

ESI 

25.0 

3,161-5,000 

CLn 

1.3 

1.8 

2.8 

4.0 

5.8 

sts 

bh 

21.0 

CLt 

1.0 

1.6 

2.4 

3.5 

5.4 

So 

HI 

18.0 

CLr 

1.6 

2.0 

3.5 

5.0 

7.5 

1L51 

26.0 

5,001-8,000 

CLn 

1.2 

1.7 

2.5 

3.6 

5.8 

8.5 

20.0 

CLt 

1.0 

1.5 

2.2 

3.4 

5.0 

7.5 

11.0 

17.5 

K39 

1.2 

2.2 

3.2 

4.5 

7.0 

10.0 

KS1 

23.0 

Over  8,000 

EkS 

1.1 

1.6 

2.4 

3.5 

5.5 

8.5 

Ed 

19.0 

Ha 

1.0 

1.4 

2.2 

3.1 

4.8 

7.0 

Bo 

17.0 

m 

0.65 

1.0 

1.5 

mm 

4.0 

6.5 

10.0 

15.0 

Average  Outgoing  Quality  Limit  (AOQL) 
in  Defects  per  100  Man-Hours 


j  Proceed  in  direction  of  arrow  until  first  plan  is  encountered. 
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TABLE  III  —  Average  Fraction  Inspected  (AFI)  at  the  Acceptable 
Quality  Level  (AQL),  in  Percent  of  Shop  Man-Hours 
Inspection  Level  II. 


Production 

Interval 

(Man-Hours) 


Acceptable  Quality  Level  (AQL) 
in  Defects  per  100  Man-Hours 


0.40 


0.65 


1.0 


1.5 


2.5 


4.0 


6.5 


10.0 


0-125 

1 

I 

l 

1 

l 

11.59 

10.75 

9.11 

126-200 

1 

1 

1 

1 

11.59 

10.75 

9.11 

8.56 

201-315 

i 

I 

1 

11.59 

10.75 

9.11 

8.56 

6.47 

316-500 

1 

1  . 

11.59 

10.75 

9.11 

8.56 

6.47 

5.82 

501-800 

1 

11.59 

10.75 

9.11 

8.56 

6.47 

5.82 

4.25 

801-1,250 

11.59 

10.75 

9.11 

8.56 

6.47 

5.82 

4.25 

3.14 

1,251-2,000 

10.75 

9.11 

8.56 

6.47 

5.82 

4.25 

3.14 

2.44 

2,001-3,160 

9.11 

8.56 

6.47 

5.82 

4.25 

3.14 

2.44 

2.00 

3,161-5,000 

8.56 

6.47 

5.82 

4.25 

3.14 

2.44 

2.00 

1.40 

5,001-8,000 

6.47 

5.82 

4.25 

3.14 

2.44 

2.00 

1.40 

0.88 

Over  8,000 

5.82 

4.25 

3.14 

2.44 

2.00 

1.40 

0.88 

•  0.72 

0.65 

1.0 

1.5 

2.5 

4.0 

6.5 

10.0 

15.0 

Average  Outgoing  Quality  Limit  (AOQL) 
in  Defects  per  100  Man-Hours 


(Proceed  in  direction  of  arrow  until 
first  plan  is  encountered. 


System  Optimization 

With  the  probability  values  associated  with  the  CL,  the  general  system  design,  and  the 
relationship  among  the  sample  hours  under  various  levels  of  inspection  fixed,  it  remained  to 
determine  the  sample  hours,  //„,  and  values  of  the  k,' s,  the  run  lengths  for  the  switching  rules, 
in  order  to: 

1.  Meet  fixed  values  of  AOQL,  and 

2.  Minimize  the  AFI  if  the  process  is  operating  at  (or  below)  the  AQL. 

Relationships  Among  Sample  Hours 

Initial  study  showed  that  system  characteristics  were  more  sensitive  to  average  sample 
hours  and  to  selected  run  lengths  (the  values  of  the  *,’s  in  Figure  1)  than  to  the  relationship 
between  the  sample  hours,  hr ,  h„ ,  and  6,,  specified  for  a  given  system.  This  relationship 
afforded  a  great  deal  of  flexibility  in  the  choice  of  relationship  between  hr,  h„ ,  and  h,. 

For  practical  reasons  related  to  system  operation  and  analysis,  a  10<  geometric  relationship 
between  hr  //„,  and  h,  was  fixed.  The  values  eventually  chosen  for  the  scheme  were: 

h,  —  10'° 4  hn,  and 

h,  =  10° 2  /!„. 
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The  net  result  was  that,  along  any  secondary  diagonal  of  the  system  (i.e.,  moving  diagonally 
from  lower  left  to  upper  right  in  a  table),  the  parameter  of  the  Poisson  distribution  function, 
0/f„,  remains  constant.  In  addition,  the  same  Poisson  parameters  apply  across  three  diagonals, 
one  for  /»„,  and  //,.  Among  other  technical  advantages  relating  to  system  analysis  and 
(attempted)  optimization,  this  structure  permitted  a  substantial  reduction  in  the  number  of 
Operating  Characteristic  Curves  required  to  fully  describe  an  Inspection  Level  system  of  plans.2 

A  FORTRAN  Program  was  developed  which  permitted  the  input  of  a  number  of  combi¬ 
nations  of  the  A.’s,  and  iteratively  solves  for  the  values  of  h„  (and  thus  hr  and  h,)  yielding  the 
required  AOQL.  A  flow  diagram  of  this  program  is  shown  in  Figure  6. 


Figure  6.  Flow  diagram  of  primary  analysis  program 


2There  are  73  sampling  systems  specified  for  Inspection  Level  II  containing  three  separate  sampling  plans  each.  How¬ 
ever,  only  13  sets  of  Operating  Characteristics  Curves  are  necessary  to  fully  describe  the  system. 
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Just  as  the  parameter  of  the  Poisson  distribution  function  remains  constant  along  any 
secondary  diagonal  in  the  scheme,  the  product  of  the  AQL  times  the  Production  Interval,  //, 
also  remains  constant.  It  is  therefore  convenient  for  analytical  purposes  to  work  with  the  ratios 
of  the  sample  hours  to  the  Production  Intervals,  fx  =  hJH ,  rather  than  with  hx  directly.  The 
flow  diagram  reflects  this  fact. 

In  each  specification  of  an  /„,  it  is  necessary  to  search  the  AOQ  function  to  locate  the 
value  of  9  at  which  the  function  reaches  its  maximum.  This  is  accomplished  by  the  method  of 
Golden  Sections  [10,  p.  537],  The  AOQ  function  is  then  evaluated  at  this  point  to  obtain  the 
AOQL.  The  AOQL  found  is  then  tested  against  the  required  value.  The  value  of  /„  is  then 
adjusted  either  upward  to  downward  using  a  bisection  search  routine  until  the  required  AOQL  is 
obtained.  Once  this  procedure  has  been  carried  through,  the  resulting  values  of  /,„  fr,  and  /, 
apply  to  all  systems  along  the  applicable  secondary  diagonal. 

The  Analysis  Program  was  run  on  a  number  of  combinations  of  switching  rules  (values  of 
the  k,' s)  and  geometric  relationships  between  /„  and  f,  and  /,.  Values  of  the  AFI  evaluated  at 
the  AQL  were  then  tabulated  in  a  form  similar  to  that  illustrated  in  Table  IV  for  each  secondary 
diagonal.  Results  for  secondary  diagonals  6  and  10  are  illustrated  here  because  the  region 
between  thesd  diagonals  includes  almost  all  plans  currently  in  use  by  the  company.  Secondary 
diagonals  may  be  identified  in  Table  I  by  the  number  in  parentheses  beneath  the  Production 
Interval  designation  in  the  first  column. 


TABLE  IV  —  Values  of  Average  Fraction  Inspected  (AFI)  Evaluated 
at  the  A  QL  for  Selected  Combinations  of  Sampling  Systems 
for  Two  Secondary  Diagonals  of  Table  I. 


fr 

ft 

Diagonal  No 

6 

Diagonal  No.  10 

%  ^ 

IO-04/,, 

1 0° 2  /„ 

io-04/;, 

io04/„ 

IO~°2/„ 

io02/;. 

— .  . 

IO04/,, 

to02/,, 

10^4/„ 

io04/,, 

1*1 

*2 

*3 

*4 

*5 

7 

3 

7 

3 

5 

X 

0.132 

deg. 

x 

0073 

0.072 

5 

5 

7 

3 

5 

0.152 

0.118 

deg. 

0073 

0.069 

0.064 

5 

5 

7 

3 

5 

0.152 

0.116 

deg 

0069 

0.066 

0.055 

5 

5 

5 

5 

5 

X 

0.171 

deg. 

X 

0.081 

0.093 

5 

5 

5 

3 

5 

0.154 

0.118 

deg. 

0.071 

0.066 

0.055 

5 

5 

5 

3 

3 

0.187 

0.1 59 

0,130 

0.068 

0.082 

0.094 

5 

3 

5 

3 

5 

X 

0.120 

deg 

X 

0.071 

0.066 

JL„ 

3 

_ 

3 

0.188 

0.134 

0.163 

0.076 

0.098 

0.086 

The  "X"  entries  in  Table  IV  indicate  those  combinations  not  analyzed.  The  "deg"  entries 
indicate  degenerate  plans  for  that  combination  along  that  secondary  diagonal.  Any  plan  must 
allow  for  at  least  one  defect  to  lie  in  the  zone  of  the  control  chart  between  the  AQL  central  line 
and  the  control  limit.  Also,  at  least  2  defects  are  required  in  the  zone  above  the  Control  Limit 
if  the  switching  rules  are  to  work  properly.  Therefore,  any  plan  for  which  one  defect  results  in 
a  point  plot  above  the  control  limit  is  by  definition  degenerate.  Such  was  the  case  along  diago¬ 
nal  6  for  most  plans  under  the  column  fr  —  10“O4/„,  /,  =  1004/„. 

It  should  be  added  that  no  combination  yielded  minimum  API's  for  all  diagonals.  How¬ 
ever,  those  under  the  column  f,  =  l0~04/„,  f  -  1002/„  and  for  switching  rules  combination 
(5,  5,  7,  3,  5)  yielded  the  minimum  most  frequently  and  thus  became  the  switching  rule  set 
chosen. 
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Implementation  of  the  System 

The  company  was  provided  with  a  procedural  document  contairing  a  complete  set  of 
tables  similar  to  Tables  I,  II,  and  III,  Operating  Characteristic  Curves  similar  to  Figure  5,  and 
directions  on  use  of  the  system.  While  they  were  provided  with  the  mathematical  formulation 
of  the  system,  their  interest  was  in  the  tabulated  results  which  allowed  them  to  determine  when 
they  should  be  on  detailing  inspection  and  when  on  sampling. 

Because  of  the  similarity  of  the  system  design  to  the  procedural  aspects  of  M1L-STD- 
105D,  there  was  little  difficulty  in  making  the  transition  to  the  new  system.  After  six  months 
of  operation  in  more  than  sixty  shops,  the  new  system  has  produced  positive  results.  The  trend 
has  been  steadily  downward  in  defects  found  in  items  out  in  the  field.  Also,  the  new  system 
has  made  it  possible  to  respond  to  changes  in  quality  level  much  quicker  than  the  previous  sys¬ 
tem  because  information  is  processed  weekly  in  the  shop  rather  than  monthly  by  a  remote  com¬ 
puter  center. 
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Appendix  A 

THEORETICAL  BASIS  OF  MODEL 

Because  of  me  nature  of  the  sampling  system,  it  is  not  necessary  to  have  explicit  func¬ 
tions  for  each  of  the  state  probabilities  but  only  to  have  them  in  terms  of  the  combined  states 
under  Normal  (N),  Reduced  (R),  Tightened  (T),  and  100  percent  Detailing  (D)  inspection  lev¬ 
els.  For  each  of  the  sampling  states,  a  designated  sample  size  is  drawn  from  a  total  of  H  hours, 
a  Production  Interval.  However,  when  a  transition  is  made  to  detailing,  the  time  spent  in  each 
detailing  state  upon  a  transition  into  that  state  is  h„  hours  where  h„  -  f„H. 

Consider  a  Markov  Renewal  Process  with  transition  matrix  P  =  [/>„■]  as  shown  in  Figure  3 
and  interarrival  (or  sojourn)  times  xu.  Suppose  x„  denotes  the  length  of  time  during  which  the 
system  is  in  state  /  and  going  to  state  j ,  and  denote  the  distribution  function  of  x„  by  F„(  ). 
For  the  model  under  consideration. 
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H  if  i  €  R  U  N  U  T 
*•>  =  {/,„  if  /  €  D 

where  R  denotes  the  set  of  states  for  reduced  inspection,  N  for  normal  inspection,  etc.  Note 
that  F,j(  )  only  depends  on  i.  Let 

( A .  1)  21  =  (Wq,  It  |,  . . .  ,  7 Tk) 

denote  the  stationary  probability  vector  for  P,  and  let 

X>,  =  P(R) 

,tR 

I  r r,  -  P(A0 

/e.v 

2>,  =  P(D 

/€  r 

£  7T,  =  P(D). 

i(0 

P()  are,  therefore,  the  steady-state  probabilities  of  being  in  R ,  ,V,  T,  and  Z)  inspection  resulting 
from  solution  of  the  Markov  chain. 

Consider  any  real-valued  functions  /(/,  j,  x)  and  let  J„  denote  the  state  of  the  system  at 
the  n'1'  transition.  Define 

(A  2)  N> 

W,(0  =  I  /(•/„-!.  ■/„.  *„) 

rt-l 

where  jV,  is  the  number  of  transitions  in  (0,  r]  and  X„  is  the  sojourn  time  between  f„_ ,  and  J„. 

To  investigate  the  fraction  inspected,  we  are  interested  in  the  specific  function 
(-4.3)  h,  if  /  6  R 

f(i,  j,  x)  =  h„  if  /  €  jVU  D. 

/?,  if  /  €  T 

Now,  Hy(r)//is  approximately  the  fraction  inspected  out  of  t  standard  man-hours  of  labor. 

The  limiting  properties  of  wr(t)  are  found  by  looking  at  the  return  times  of  a  specific 
state,  say  state  0,  and  considering 

y„  -  M7',,. «+ 1>  ~  WA Tq,,) 

where  t0  n  is  the  time  of  the  n"’  return  to  0. 

The  following  notation  is  required: 
jMki  -  £[number  of  visits  to  state  /  until  entry  j,  starting  from  A] 

0M0,  =  m,  =  (tt  i/wf)) 

£„(/)  -  J  x  /('.  j.  x)plidFii(x) 

*,(/>  -  If,  (/) 

dPif)  -  f  ^  /Hi,  j.  x)  p,idF„(x) 
f,J,(/)  »  If'2,(/) 
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Certain  basic  results  then  follow  from  [8J.  If  f,(|/|)  ^  °o(  then 

£(>',,)  -  £  m ,(,(/) 

I 

Letting  /x(X)  denote  the  mean  recurrence  time  of  state  0  and  rj,  -  £(*,,),  it  follows  that: 

Moo  “  Z  T»  w 

/ 

Under  certain  general  conditions,  as  (—00, 

w}'*  **  £(  Y„) 

1  Moo 

For  /(/,  7,  x)  as  in  equation  A. 3, 

5>,£,(/)  =  hrP(R)  +  h„P(N)  +  h,P(T)  +  hnP(D)  -  tt0£(  Y„) 

i 

and 

Z  nA,  “  h„P(D)  +  H(  1  -  £(£))  -  woMoo- 

i 

Therefore,  letting  FI  denote  "fraction  inspected,"  we  have 

(A  A)  />,£(£)  4-  h,P(T)  +  hnlP(N)  +  P(D)  ] 

//„£(Z»  +  //(l  -  />(/))) 


This  justifies  the  results  given  for  the  A  FI  in  the  section  titled  "Formulation  of  Operating 
Characteristics  of  the  System  Model,"  and  leading  to  equation  5.  Other  functions  can  be 
defined  to  give  further  properties  of  the  system.  For  example,  let 

\H,  if  /  €  R 

fr  j>  x  Q  otherwise 

The  the  fraction  of  time  spent  in  reduced  inspection  is  given  by 

", 

Z  MJn-U  Jn >  X.) 

Jizl _  “  _ HP(R) _ 

t  h„P(D)  +  H[  1  -  P(D)\ 

with  similar  results,  except  for  state  D ,  for  the  other  three  inspection  states.  For  state  D, 

hn,  if  i  €  D 

fdd,  j<  x)  Q  otherwise 


Z  M-U  Jr,,  X„) 

»- 1 _  ^  h„P(D) _ 

t  h„P(D)  +  H{\  -  (£>)] 

These  results  are  useful  in  describing  the  operating  characteristics,  and  corresponding  Operating 
Characteristic  (O.C.)  Curves,  for  the  sampling  systems.  The  formulas  are  developed  in  the 
preceding  section  of  he  paper  wherein  P(  )  denotes,  as  above,  the  steady  state  probabilities  of 
R,  N,  T,  and  D  inspection  resulting  from  solution  of  the  Markov  chain.  £'(•)  denotes  the 
time-weighted  probabilities  of  the  respective  states.  Thus,  for  example: 
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(4.5) 


P'(R) 


HP(R) 


h„P(D)  +  HI  1  -  P(D)) 


APPENDIX  B 

GENERAL  SOLUTION  OF  THE  MARKOV  CHAIN 
Steady-State  System  Equations 

The  equations  describing  the  steady  state  probabilities  for  the  general  system  are  as  fol¬ 
lows  where: 

P  (X)  =  non  time-weighted  probability  of  being  in  state  X. 

/?,,  N„  <V',  T,,  and  D,  -  sub-states  of  Reduced  (/?),  Normal  (A'), 

Tightened  ( T ),  and  Detailing  ( D )  states,  respectively. 

(B  la)  P(R)  -  ph(r)P(R,-0  -  p^r)1"' P(R\)  for  <-2,3 . k2 


(B  ib)  />(/?,)  =  p,(r)  IX  M,)l  +p,(n)P(Nk  ) 


(B.ic)  p(r)  -  im,) 


1  -  Pi,(r) 


1  -  Pi,(r) 


P(R ,) 


(B.2a)  P(T)  =  p,U)P(T, _,)  -  p/(/)'  l/»( r,)  for  /  -  2,3 . *4 


*4  . 

(B  2b)  P(Tl)  =  ph(, )  m,)]  +  ph(n)P(Nk})  +  (?,(*)  +  p„(n))  P(Dk ) 

/-i 


(B.2c)  P(T)  =  52  ^(7-,) 


<-! 


1  ~  M'M 


1  -  Pi(l) 


P(T\) 


(B.3a)  P(D{)  -  [Pl(n)  +  p„(«)l  />(£>, _s)  -  lp,(«)  +  p^n)]1'' P(DJ 
for  i  =  2,3 . 


P(D,)  -  ll  -  />,(/•)  -  ph(r)\  [£/>(*,)] 


;-i 


(B.3b) 


+  [1  -  p,(n)  -  P/,(n)l  [£#»(*,)  +  £P(ArO] 
1-1  1-2 

*4 

+  (1  >,U) -P/l(0]  liPCTjl 


i-\ 


+  [l  -p(d)]  [£P(A)1 

i-i 
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(B.8) 


For  notational  simplicity,  define: 

*  i  i 

S,in)  =  £  />/(«)'"  *  (I  -  Piln)  ']/fl  —  /»/(«)] 

/-I 


Similarly,  Shin),  Sir),  Sit )  and  $(</)  are  defined  as  in  (B.8)  with  Pi(n)  replaced  by  />,,(«), 
p„ir),  P/0)  and  pid),  respectively,  and  with  k\  replaced  by  ky,  k2,  ky,  and  ky,  respectively. 
Also  let, 

(B.9)  g  =  [i  -  p((/-)S(/-)l/[p((n)A|  ']. 

Using  equations  B.l  through  B.7  and  the  notational  forms  of  B.8  and  B.9,  the  following  six 
equations  are  obtained: 

(B.10)  PlU)k*  P(T\)  +  Ph(r)ki  />(/?,)  -  P(N0  =  0 

(B.l  1)  />,(»)  '  PIN ,)  +  IS*(»)  -  1)  PiN2)  ~  PW 2)  -  0 

ph\n) 

(B.12 )phin)  ■  PGV,)  +  lS,(n)  -  ll  P(N2)  -  PiN2)  =0 

P/in) 

(B.13)  [Pl,it)Sit)  -  1]  P(Tt)  +  ph(n)ki~l  P(N2)  +  pU)‘5P<D,)  =  0 

(B.14)  [p,(r)S(r)  -  1]  P(R,)  +  p,(n)kr'  PiN2)  =  0 

(B.15)S(r)P(P,)  +  S(f)P(r,)  +  Sid)  PiD^)  +  PiN^)  +  — - .  ^  -  P(N2)  + 

Pi(n) 


Si, in)  -  1 
Pi,(n) 


PiN2)  =  1 


Using  equation  B.14,  noting  that  Pi N2)  =  gPiR (),  and  making  appropriate  substitutions, 
a  system  of  five  equations  in  five  unknowns  can  be  derived  which  can  be  solved  by  any  suitable 
method. 

A  Cramer’s  Rule  solution  was  applied  to  the  preceeding  equations  to  obtain  the  following 
results  for  the  major  system  states: 

(B.16)  PiD)  =  Sid)PiD{)  =  Z,/C 

(B.17)  Pi  T)  =  SU)P(Ti)  -  Z2/C 

(B.18)  P(R )  =  Sir)PiR0  =  Zy/C 

(B.19)  PiN)  -  1  -  PiD)  -  PiT)  -  PiR), 

where: 

Z,  =  5 id) \phir) "2  p,in)S„in)  [1  -  p„(r).S(/)]  -  *  [1  -  Pi,it)Sii)) 
lShin)  +  S,in)  -  Shin)Siin)]  +  gphin)ki  piit)k*  S,in)} 

Z2  »  Sit)pid)ki  {p,,ir)  k}  piin)  Shin)  -  g[Shin)  +  S,0i)  -  S,,(tt)S,(n)l) 

Zy  =  Sir)[—pid)ks  Piit)ki  Piin)Si,in )) 

and. 


C  -  Z,  +  Z2  +  Z,  -  g  ■  pid)ki  P/(t)k 4  S„(/t)S,(«). 


A  SINGLE  SERVER  QUEUE  WITH  ARRIVAL  RATE 
DEPENDENT  ON  SERVER  BREAKDOWNS 
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ABSTRACT 

This  paper  considers  a  single  server  queueing  system  that  alternates  sto¬ 
chastically  between  two  states:  operational  and  failed.  When  operational,  the 
system  functions  as  an  M/Ek/\  queue  When  the  system  is  failed,  no  service 
takes  place  but  customers  continue  to  arrive  according  to  a  Poisson  process: 
however,  the  arrival  rate  is  different  from  that  when  the  system  is  operational 
The  durations  of  the  operating  and  failed  periods  are  exponential  with  mean 
l/irt  and  Erlang  with  mean  l/r/3,  respectively.  Generating  functions  are  used 
to  derive  the  steady-state  quantities  /.  and  fC.  both  of  which,  when  viewed  as 
functions  of  c,  decrease  at  a  rate  inversely  proportional  to  c2.  The  paper  in¬ 
cludes  an  analysis  of  several  special  and  extreme  cases  and  an  application  to  a 
production-storage  system. 


In  many  queueing  systems  (e.g.,  a  computer  facility),  the  server  is  subject  to  breakdown. 
If  the  breakdowns  are  unpredictable  in  nature  and  the  server  is  not  replaced  or  repaired  until  a 
breakdown  occurs,  then  the  facility  will  be  unable  to  provide  uninterrupted  service  to  its  custo¬ 
mers.  In  such  a  case,  it  is  important  to  understand  how  the  breakdowns  will  affect  the  system’s 
level  of  performance. 

Avi-Itzhak  and  Naor  [11  and  Gaver  [3]  obtained  the  steady  state  quantities  L  and  W  for 
an  A//G/1  queue  whose  unreliable  server  alternates  between  operational  periods  of  exponential 
duration  and  failed  periods  of  arbitrary  random  duration.  Although  general  with  respect  to  the 
distributions  of  the  service  and  repair  times,  the  results  have  the  disadvantage  of  requiring  a 
Poisson  arrival  process  with  a  constant  rate;  that  is,  an  arrival  rate  not  dependent  upon  whether 
the  server  is  operational  or  failed. 

Yechiali  and  Naor  [7]  and  Fond  and  Ross  [2]  both  considered  variations  of  a  single  server 
exponential  queueing  model  in  which  the  arrival  and  service  rates  alternate  between  the  pairs 
(A),  mi)  and  (A2,  M2K  with  the  length  of  time  the  system  operates  with  pair  (A,,  /x,)  being 
exponentially  distributed  with  rate  ca,,  i  —  1,2.  In  [7],  the  steady  state  quantity  L  was  derived 
for  a  system  with  infinite  queue  capacity  while,  in  [2],  the  steady-state  proportion  of  customers 
lost  was  obtained  for  a  system  in  which  any  arrival  finding  the  server  busy  is  lost.  The  special 
case  hi  —  0  results  in  models  of  queueing  systems  subject  to  breakdown  and  having  Poisson 
arrival  rates  dependent  upon  the  operation  or  breakdown  of  the  server;  however,  all  probability 
distributions  are  restricted  to  be  exponential. 

The  model  developed  here  is  an  important  one  that  cannot  be  obtained  as  a  special  case  of 
the  models  in  the  literature.  In  particular,  consider  a  single  server  queueing  system  with  the 
following  characteristics: 
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(a)  The  system  alternates  between  two  states:  the  operational  state  and  the  failed  state 
(also  referred  to  as  the  repair  slate). 

(b)  When  operational,  the  system  functions  as  an  M/EJ\  queue;  that  is,  customers 
arrive  according  to  a  Poisson  process  with  rale  A,  and  service  is  according  to  an  Erlang  distribu¬ 
tion  with  mean  1  In  and  shape  parameter  k. 

(c)  If  service  to  a  customer  is  interrupted  by  a  breakdown,  resumption  takes  place  as 
soon  as  the  repair  period  ends  with  no  loss  of  service  involved. 

(d)  Although  no  service  takes  place  during  the  repair  period,  customers  continue  to 
arrive  according  to  a  Poisson  process,  but  now  having  a  rate  of  A(  instead  of  A. 

(e)  The  duration  of  operating  periods  is  exponential  with  mean  \/ca  and  the  duration  of 
repair  periods  is  Erlang  with  mean  l/c/3  and  shape  parameter  m. 

This  model  is  not  a  special  case  of  [7]  because  it  permits  both  the  service  and  repair  times  to 
have  Erlang  distributions  rather  than  restricting  them  to  be  exponential.  Furthermore,  the 
model  is  not  a  special  case  of  [1]  and  [3]  because  the  Poisson  arrival  rate  is  state  dependent 
when  A |  5^  A.  Such  an  arrival  process  is  useful  in  many  practical  situations  where  the  custo¬ 
mers  are  aware  of  when  the  server  is  inoperable;  in  such  cases,  one  expects  to  find  A|  <  A  or 
even  A ,  =  0. 

The  constant  c  in  assumption  (e)  controls  how  rapidly  the  system  oscilates  between  the 
operational  and  failed  states.  Holding  a  and  fi  constant  while  increasing  c  has  the  effect  of 
keeping  the  steady  state  probabilities  of  being  in  the  operational  and  failed  states  constant  while 
increasing  the  frequency  with  which  the  system  changes  states. 

The  remainder  of  this  paper  is  organized  as  follows:  Section  1  analyzes  the  queueing  sys¬ 
tem  described  by  assumptions  (a)  -  (e).  Some  special  and  extreme  cases  of  the  general  model 
are  considered  in  Section  2.  Section  3  not  only  shows  that,  as  functions  of  c,  both  L  and  W 
decrease  at  a  rate  inversely  proportional  to  c2  but  also  investigates  the  behavior  of  the  system  as 
c  — •  oo.  The  paper  concludes  in  Section  4  with  an  application  to  a  production-storage  system. 


1.  STEADY  STATE  RESULTS 
Preliminary  Analysis 

Throughout  this  section,  as  well  as  Sections  2  and  4,  the  constant  c  will  be  assumed  to 
equal  1.  This  eliminates  the  need  to  carry  c  along  in  all  the  derivations  when  it  is  only  relevant 
to  the  analysis  in  Section  3. 

The  "method  of  phases"  (cf.  14,  p.  168])  provides  a  convenient  means  of  obtaining  the 
steady  state  results.  It  is  well-known  that  an  Erlang  random  variable  with  mean  l/ja  and  shape 
parameter  k  is  equivalent  to  the  sum  of  k  independent,  exponentially  distributed  random  vari¬ 
ables  each  having  the  same  mean  l/A/x.  Hereafter,  both  the  Erlang  service  times  and  Erlang 
repair  times  of  the  model  will  be  viewed  as  consisting  of  a  series  of  idenii..  >1  and  independent, 
exponentially  distributed  phases. 
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The  system  can  now  be  analyzed  as  a  continuous  time  Markov  process  with  states  { ( /,  j) 
|/  —  0,  1 ,  m  and  j  -  0,  1,  2,  ...}  where  /— 0  denotes  the  system  is  operational. 
1  <  (  ^  m  denotes  the  number  of  phases  remaining  in  the  repair  process  until  the  system 
becomes  operational,  and  j  denotes  the  number  of  service  phases  in  the  system  (the  sum  of  the 
number  of  phases  remaining  for  the  customer  in  service  and  k  times  the  number  of  customers 
in  the  queue).  The  transition  probabilities  are  stationary  and  satisfy  the  Kolmogorov 
differential  equations.  Furthermore,  the  steading  state  probabilities  { p,,}  exist,  are  independent 
of  the  initial  state,  and  satisfy  the  following  balance  equations: 


(la) 

(Ai  +  ml 3) 

PmO 

=  a  Poo 

(j  -  0) 

(lb) 

(\i  +  mi 3) 

Pi  0 

-  m/3  p,+ I.o  (1  <  /  <  ffi-1) 

(J  -  0) 

(lc) 

(X  +a) 

Poo 

-  mfi  P\o  +  kpp0\ 

0  -  0) 

(Id) 

(X!  +  m/3) 

Pmi 

“  «  POj  +  X|  Pm.j-k 

0  >  0) 

(le) 

(X|  +  ml 3) 

Pu  =  ">/3  p,+u  +  X,  P„_*.  (1  <  »  <  m  - 1) 

0  >  o) 

(If) 

(X  +  a  +  k/j.) 

Poi 

“  mfi  pm  +  X  Po,i~k  +  X/zpo./+i 

O'  >  o) 

where  a  negative  subscript  in  (Id)  -  (If)  indicates  the  term  is  zero.  Figure  1  contains  the  por¬ 
tion  of  the  Markov  chain’s  state  transition  diagram  corresponding  to  states  (i,  j)  with 
0  <  /'  <  m  and  j  >  k.  It  is  clear  from  the  figure  that  equations  (1)  can  be  interpreted  as 
requiring  the  mean  transition  rates  into  and  out  of  a  state  to  be  equal  at  steady  state. 
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Let  p„  -  L“o  Po,  and  p,  -  I",  I “0  P,j\  that  is,  p»  and  p ,  are  the  steady  state  probabili¬ 
ties  of  the  system  being  operational  and  failed,  respectively.  On  considering  the  underlying  two 
state  (operational  and  failed)  stochastic  process,  it  is  immediate  that 

Pw  -  P/(<*  +  0). 

p,  —  a/(a  +  / 3). 

Let  the  average  arrival  rate  and  average  service  rate  in  steady  state  be  denoted  by  X  -  X pw  + 
X, p,  and  £  -  m/V,  furthermore,  let  r  «  X/£.  It  will  be  demonstrated  shortly  that,  as  is  often 
the  case,  X  <  £  is  a  condition  for  steady  state.  Note  that  each  of  the  quantities  pw,  p ,,  X,  fi., 
and  r  would  be  independent  of  ceven  if  the  temporary  assumption  c  -  1  were  dropped. 

The  Generating  Function 

Generating-function  techniques  must  be  used  to  further  analyze  the  model  as  there  is  no 
way  of  solving  (1)  in  a  recursive  manner  to  obtain  closed-form  expressions  for  the  ( p„).  Define 
the  generating  functions 

G,(z)  -L~0  P,,**  M  <1.  '  “0,1,2 . m 

(2)  G(z)  -IZoGAz)  \z\  <  1. 

Multiplying  each  equation  of  the  sets  {(la),  (Id)),  {(lb),  (le)},  and  {(lc),  (If))  by  z'and  sum¬ 
ming  over  all  j  yields,  respectively, 

(3)  Gm(z)  -  [«/ (X j  +mi 3-  X|Z*)]  G0(z). 

(4)  G,(z)  =  [m/3/(X,  +  m/3  -  X,z*)]  G,+,(z),  (1  <  /  <  m  -  1), 

(5)  G0(z)  -  [m/3z  G,(z)  -  kp.  Poo(\  -  z)]/I(X  +  a  +  kfi)z  -  \zk+'  -kp.). 

Equations  (3)  and  (4)  can  be  used  recursively  to  express  Gi(z)  in  terms  of  G0(z)  as 

(6)  G|(z)  =  (a/m/3)  [m/3/(X,  +  m/3  -  X,zfc>]'"  G0(z) 

and  (  5  )  can  be  rearranged  as 

(7)  Gt(z)  =  (m/3z)_’{I(X  +  «  +  kp)z  -  Xz*  +  I  -  kn)  G0(z)  +  *MPood  ~  *))• 

Equating  the  expressions  for  G\(z)  in  (6)  and  (7)  and  solving  for  Go(z)  gives 

(8)  G0(z)  -  Um  Pood  -  z)  l/(z)P)/D(z), 
where 

(9)  /(z)  -  1  +  (X,/m/3)  (1  -  zk), 
and  the  denominator  is 

(10)  D(z)  -  az  +  [kp  +  \zk+'  -  (X  +  a  +  kp)z]  l/(z)]m. 


m 
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Using  (3)  and  (4)  recursively  results  in 

(ID  G,(z)  -  | (a/m/3)  Ap  Poo(\  -  z)  [J(z)\'-')/D(z)  (1  <  /  <  m). 

G(z)  can  now  be  calculated  from  (2),  (8),  and  (11)  as 

(12)  G’(z)  =/>oo(jV(z)/D(z)], 
where 

(13)  N(z)  =  km (1  -  z)  {[/(z)]m  +  (a/m/3)  H/'Iq1  l/(z)]'). 

Using  G'(l)  =  1  and  computing  lim;_|G(z)  by  applying  LHospital’s  rule  to  (12)  yields,  after 
algebraic  simplification, 

(14)  p0o  =  (1  -  r)  p„  . 

Substituting  (14)  into  (12)  results  in  a  final  expression  for  G(z),  that  is 

(15)  G(z)  =  (1  -  r)  lp/(a  +  fi)]  [N(z)/D(z)). 


Since  Poo  >  0,  (14)  also  verifies  the  previously  mentioned  condition  for  steady  state,  A  <  p. 

The  busy  fraction  p  =  1  -  Z/"0  p,0  equals  1  -  G'(0)  and  can  be  evaluated  from  (15),  (9), 
(10),  and  (13).  Provided  A|  >  0, 

p  =  1  -  (1  -  r)  [/3/ (a  +  /3) )  (1  +  (a/kt)  [1  -  (m/3/(X|  +  m/3))'"]}. 

In  general,  then,  (A/p);  however,  if  X|  =  0,  p  =  (A/p)  does  hold. 

Recursions  for  the  {p0) 

Unfortunately,  no  simple  relationship  exists  relating  the  (p,;)  to  poo*  P io . Pm o-  How¬ 

ever,  the  [p,j)  can  be  computed  efficiently  from  (14)  and  the  set  of  recursive  equations  (for 
j-  0,  1,  2,  ...) 

(16a)  p,„,  =  (X,  +  m/3)-1  (ap0/  +A,pm./_*) 

(16b)  p,i  =  (X j  +  m/3)-1  (m/3pl  +  |  ,  +  X , >  (/  -  m  —  1,  m  —  2 . 1) 

(16c)  p0  /  +  ,  =  (Xp)-l(X  p0«  +  a  Z,!_o  Poh  ~  w^I/.oPi,,) 

where  a  term  is  zero  if  it  has  a  negative  subscript  and  the  lower  limit  of  summation  in  the  first 
term  of  (16c)  is  reset  to  0  if  it  is  negative.  Equations  (16a)  and  (16b)  are  obviously  equivalent 
to  (Id)  and  (le)  while  (16c)  follows  from  (If)  and  a  simple  inductive  argument.  Of  course, 
the  steady-state  probability  of  having  n  customers  in  the  system  is  given  by  1  -  p  for  n  =  0 
and.  for  n  >  0,  by  L'I0  !;*(„_„*+, p,,. 

Computation  of  L 

The  computation  of  L  and  the  steady-state  average  number  of  customers  in  the  sys¬ 
tem  and  in  the  queue,  respectively,  require  some  preliminary  results.  Let  Lp  and  Lp  be 
steady-state  notation  for  the  average  number  of  customer  service  phases  in  the  system  and  in 
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the  queue,  respectively.  Furthermore,  let  Lp  denote  the  average  number  of  service  phases 
remaining  for  the  customer  (if  any)  in  service.  The  following  relationships  clearly  hold: 

(17)  Lp-  kLq, 

(18)  Lp+Lp 


(19)  L  =  Lq  +  p. 

Substituting  (17)  into  (18)  and  solving  for  Lq  results  in 

(20)  L„-  (Mk)  (Lp- Lp). 

Relationships  (19)  and  (20)  then  yield 

(21)  £.  =  (1/*)  (Lp- L?)  +  p. 

The  problem,  then,  is  to  compute  Lp  and  Lp. 

Now  i/'=G'(l);  however,  evaluating  G' (1)  is  not  easy.  Expressing  G(z)  =  Poo 
I V(z)/D(z)  and  using  L’HospitaPs  rule  twice  gives 

(22)  G'(l)  =  pooled)  •  D'{  1)  -  2V'(1)  •  £>"(l)l/2l£>'(l)]2- 

The  algebraic  manipulations  required  by  (22)  are  straightforward  but  quite  long.  Because  they 
would  occupy  several  pages,  the  computations  are  omitted;  however,  they  result  in 

(23)  [P _ r__  k+  1  }  m  +  1  ka\\(p.  -  X  +  A|) 

1  -r  2  2m  A(a+0)2 

Obtaining  Lp  requires  the  development  of  another  generating  function.  In  the  M/Ek/\ 
queue  not  subject  to  breakdown,  given  that  a  customer  is  in  service  in  steady-state,  the  number 
of  phases  remaining  until  his  service  is  complete  is  equally  likely  to  be  1,  2,  ...  ,  or  k  (cf.  [4,  p. 
169]).  However,  this  is  not  the  case  when  the  queue  is  subject  to  breakdown.  Define  the  gen¬ 
erating  functions 

H,(y)  -  p, o  +  I*.,  (I“o  P,i^n)yn.  M  <  1.  '  “  0,1 . * 

(24)  H(y)  -  I™0//,(y),  \y\  <  1. 

Clearly,  Lp  -  H'(  1).  As  demonstrated  in  the  Appendix,  the  lengthy  derivation  of  H(y)  results 
in 

(25)  H(y)  -  (1  -  p)  +  (p  -  r)yk  +  r{[y(  1  -  yk)]/[k(l  -  y)]). 

Application  of  L’Hospital’s  rule  twice  to  (25)  yields 

(26)  L?  -  H'(  1)  -  (p  -  r)k  +  r [(A  +  l)/2]. 

Finally,  combining  (21),  (23),  and  (26)  results  in 


(27) 
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Computation  of  W 

The  server  may  be  idle  for  one  or  both  of  two  reasons:  the  system  is  failed  or  no  custo¬ 
mers  are  present.  Let  b  denote  the  steady-state  probability  that  the  server  is  not  idle.  Then  the 
definitions  of  X,  r ,  and  p„  and  expression  (14)  yield 

(28)  b  =  p„  -  pm  -  A/m . 

When  the  server  is  not  idle,  customers  depart  from  the  system  at  rate  p,  of  course,  when  the 
server  is  idle,  no  customers  depart  from  the  system.  Hence,  the  average  steady-state  rate  at 
which  customers  depart  from  the  system  is  given  by 

(29)  pb  =  k. 

Thus,  in  steady  state,  the  average  rate  customers  arrive  at  the  system  equals  the  average  rate 
customers  depart  from  the  system. 

Little's  formula. 


(30)  L  =  X  W, 

can  now  be  used  to  compute  IT,  the  steady-state  expected  value  of  the  time  a  customer  spends 
both  in  the  queue  and  in  service.  In  particular, 

(31)  W  «  L/k 
where  L  is  given  by  (27). 


2.  SPECIAL  AND  EXTREME  CASES 

CASE  A.  As  p  —  oo,  the  repair  periods  have  shorter  and  shorter  durations,  and,  in  the 
limit,  repair  is  instantaneous.  Intuitively,  then,  as  /3  —  <»,  the  model  developed  in  Section  1 
approaches  the  M/  EJ\  queue  not  subject  to  breakdown  and  having  constant  arrival  rate  X  and 
service  rate  p.  That  this  is  in  fact  the  case  can  be  shown  from  (15),  (27),  and  (31);  as  /3  — * 
(7(-),  L,  and  IT  all  approach  the  corresponding  quantities  for  the  MjEJ\  queue. 


CASE  B.  If  k  =  1  and/or  m  =  1,  exponential  service  and/or  repair  times  result.  When  both 
k  =  1  and  m  -  1,  expression  (27)  for  L  reduces  to  a  special  case  (p2  -  0)  of  expression  (33) 
of  Yechiali  and  Naor  17,  p.  729]. 


CASE  C.  Constant  service  and/or  repair  times  can  be  analyzed  by  letting  k  — 1 •  °°  and/or 
m  —  t».  It  is  clear  from  (27)  and  (31)  that  L  and  IT  are  decreasing  and  convex  functions  of 
both  k  and  m.  Their  limiting  values  are  obtained  by  replacing  [(X  -t-  1)/2X]  and/or 
Km  +  l)/2m]  by  1/2  in  (27)  and  (31). 


CASE  D.  If  the  Poisson  arrival  rate  is  stationary  (X,  -  X),  expressions  (27)  and  (31)  for  L 
and  W  reduce  to  special  cases  (Erlang  service  and  repair)  of  relationships  (24)  and  (26)  of 
Avi-Itzhak  and  Naor  [1,  p.  309]. 
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CASE  E.  In  some  practical  situations,  no  customers  enter  the  system  when  it  is  failed, 
either  by  their  own  choice  or  because  of  restrictions  by  the  system.  During  the  repair  process, 
then,  customers  neither  enter  nor  leave  the  system.  Thus,  it  is  intuitive  that  not  only  l.  but 
also  the  steady-state  probabilities  of  having  n  customers  in  the  system  («  =  0.  1,  2,  ...)  are 
equal  to  those  for  the  M/Ek/\  queue  not  subject  to  breakdown  and  having  constant  arrival  rate 
A  and  service  rate  p.  That  this  is  in  fact  the  case  can  be  seen  by  setting  A  (  =  0.  Then  r  =  k/p 
and,  from  (15)  and  (27),  both  G(: )  and  L  simplify  to  the  corresponding  quantities  for  the 
M/Ek/ 1  queue.  Of  course,  as  (31)  with  \,  =  0  indicates,  W  is  greater  than  in  the  M/Ek/  1 
case. 

3.  BEHAVIOR  OF  L  AND  W7  AS  A  FUNCTION  OF  < 

In  order  to  investigate  how  the  system  behaves  as  a  function  of  c,  the  assumption  of  Sec¬ 
tions  1,  2,  and  4  that  c  -  I  is  now  dropped.  Recall  that  c  controls  how  rapidly  the  system  osci- 
lates  between  the  operational  and  failed  states.  Varying  c  while  holding  a  and  /3  constant  does 
not  change  />„  and  p ,,  the  steady-state  probabilities  of  the  system  being  operational  and  failed, 
respectively.  However,  as  c  increases,  the  system  fluctuates  more  rapidly  between  the  opera¬ 
tional  and  failed  states,  or,  equivalently,  the  mean  time  the  system  stays  in  each  state 
approaches  0. 

Expressions  for  L  and  IF  as  a  function  of  c  can  be  obtained  by  replacing  a  and  li  by  c a 
and  c@  everywhere  in  (27)  and  (31).  From  the  expressions  that  result,  it  is  easily  shown  that 

L'(c )  -  -ac~2 

IF'(c)  -  -be'1 

where  a  and  b  are  positive  constants  involving  m.  A,  A,,  p,  «,  and  fi.  Hence,  as  functions  of  c, 
both  L  and  W7 decrease  at  a  rate  that  is  inversely  proportional  to  c:. 

To  interpret  this  result  qualitatively,  consider  two  equally  reliable  systems  (i.e..  identical 
pw's)  also  having  identical  k,  m,  A,  Ah  and  p:  however,  suppose  one  system  has  infrequent 
failures  but  long  repair  times  (a  low  c)  and  the  other  undergoes  frequent  but  quickly  repaired 
failures  (a  high  c).  If  the  objective  is  to  minimize  L  and  W7,  then  the  latter  system  should  be 
chosen. 

On  a  more  quantitative  level,  the  result  supports  a  general  conjecture  of  Ross  [6]  that,  in 
a  single  server  infinite  capacity  queueing  model,  the  "more  stationary"  the  Poisson  arrival  pro¬ 
cess  is,  then  the  smaller  the  average  customer  delay.  As  in  [2]  and  [6],  this  conjecture  has 
been  verified  in  a  special  case.  To  see  this,  the  behavior  of  the  system  as  c  — >  will  be  inves¬ 
tigated.  It  is  easy  to  show  from  (27)  and  (31)  that  as  c  —  both  L  and  If  approach  the 
corresponding  quantities  for  an  M/ Ek/\  queue  not  subject  to  breakdown  and  having  constant 
arrival  rate  A  and  service  rate  p.  Thus,  as  c  — >  °°,  the  system  becomes  more  stationary  in  the 
sense  that  it  behaves  more  and  r-nre  like  the  M/EJ 1  queue  with  parameters  A  and  p.  Also, 
note  that  since  L  and  W  are  deci  sing  in  c,  the  smallest  values  they  can  ever  achieve  are  the 
corresponding  values  for  the  M/Ek/\  queue  with  parameters  A  and  p. 

4.  APPLICATION  TO  A  PRODUCTION-STORAGE  SYSTEM 

By  regarding  the  server  as  a  production  process  turning  out  items  one  at  a  time  and  each 
customer  as  a  unit  demand  for  the  product,  the  results  of  Section  1  can  be  used  to  analyze  a 
production-storage  process  subject  to  breakdown  and  having  the  following  additional  charac¬ 
teristics: 
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(a)  Unsatisfied  demand  is  always  backlogged. 

(b)  Items  not  needed  immediately  to  satisfy  backlogged  demand  are  stored  for  future  use 
up  to  a  level  of  S,  the  finite  capacity  of  the  storage  facility. 

(c)  When  the  storage  facility  is  filled,  no  production  takes  place. 

In  such  a  production-storage  model,  three  quantities  of  interest  are  /,  the  average  number  of 
items  (physically)  in  inventory;  B,  the  average  number  of  backlogged  items;  and  R ,  the  fraction 
of  time  that  demand  can  be  met  without  backlogging.  For  example,  it  may  be  desired  to 
choose  S  so  that  some  or  all  of  the  conditions  /  >  c f,  B  <  c2,  and  B  ^  hold,  where 
C|,  c2,  and  c3  are  specified  design  parameters.  Meyer,  Rothkopf,  and  Smith  [5]  consider  four 
production-storage  models  differing  from  the  one  just  described  in  that  production  and  demand 
both  occur  at  constant  rates,  unsatisfied  demand  is  lost,  and  the  durations  of  operating  and 
failed  periods  have  distributions  corresponding  to  the  four  possible  combinations  of  constant 
and  exponential. 

A  state  (ij)  of  the  queueing  system  translates  into  a  stale  of  the  production-storage  sys¬ 
tem  as  follows:  0  <  j  <  kS  is  equivalent  to  kS  -  j  phases  in  storage  and  j  >  kS  is  equivalent 
to  j  -  kS  phases  backlogged.  Of  course,  /  has  the  same  interpretation  in  both  models.  Given 
this  one-to-one  correspondence  between  states  in  the  two  models,  expression  (27),  recursions 
(16),  and  the  observation  that  B  —  I  =  L  -  Scan  be  used  to  compute 

/  -  S(1  -  p)  +  I,?-,1  (S  -  n)  (I/"0  P„) 

B  =  L  -  S  +  / 

R  -  Pi,  (S  >  0). 

As  a  numerical  example,  consider  a  system  with  a  -  1,  fi  =  3,  m  —  5,  A  -  8,  X,  =  4,  /u.  =  16, 
k  —  4  and  suppose  it  is  desired  to  choose  S  so  that  /  ^  3,  B  <  l,  and  R  >  0.9S  all  hold. 
Computed  with  the  aid  of  (27)  and  (16),  the  following  table  shows  A  B ,  and  R  as  a  function  of 

S: 


B 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

i 

0.000 

HEfclil 

4.591 

6.560 

B 

1.454 

0.820 

0.460 

0.257 

0.143 

0.080 

0.044 

0.025 

0.014 

0.008 

0.004 

R 

0.000 

0.367 

0.639 

0.797 

0.886 

0.936 

0.965 

0.980 

0.989 

0.994 

0.997 

From  the  table,  it  is  clear  that  S  >  6  must  hold. 
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APPENDIX:  DERIVATION  OF  H(y) 

To  obtain  H(y)  multiply  each  equation  of  the  sets  ((la),  (Id)),  [(lb),  ( le) },  and 
{(lc),  (10)  by  y"  where 

0  if  7  “  0 

k  if  7  —  k.  2k,  3k,  ... 

j  modulo  k  otherwise. 

Summing  over  all  j  then  yields,  respectively, 

(32)  H,„(y)  =  (m/3)-'  (a//0(y)  -  A,  p,„0Cl  -  y*)l 

(33)  //,(y)  -  Hl+i(y)  -  (m/3)"’ X, pjl -/)  (1  <  J  <  «  -  1) 
tf0(y)  =  [ay  -  kfi(\  -  y)T'  [m/3y  //|(y)  -  A/aPooO  ~  y)  ~  J’O  ~  /> 

(34)  -  [A/»oo  +  (0)  —  PoiHI- 

Equations  (32)  and  (33)  can  be  used  recursively  to  express  H\(y)  in  terms  of  H0(y)  as 

(35)  //,(y)  -  Ow/8)-1  [a//o (y)  ~  A,(l  -  /)  Z,Z\  pj 
and  (34)  can  be  rearranged  as 

H\(y)  =  (mpy)-'  ([ay  -  A/x(l  -  y)l  H0(y)  +  kfi  Poo(l  -  >0 

(36)  +  y(  1  -  yk)  (Ap00  +  kfi(H0{ 0)  -  p0|)l). 

Equating  the  expressions  for  //|(y)  in  (35)  and  (36)  solving  for  //o(y)  results  in 

H0(y)  -  Poo  +  UyO  ~  J'*)1/UcmO  ~  >01} 

(37)  •  [A,  I/:t p,0  +  Apoo  +  kfi[H0(Q)  -  PoiD- 
Using  (32)  and  (33)  recursively  yields 

(38)  H,(y)  -  (m/3)-'  [ aH0(y )  -  A,(l  -  y*)  I„m-,PJ.  (1  <  '  <  «> 
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H(y )  can  now  be  obtained  from  (24),  (37),  and  (38)  as 

Hh)  -  [(a  +  0)/0]|p(K1  +  IX#»oo  +  *t  E-,Ao  +  *M(//o( 0)  -  Pot)] 

(39)  -  (X ,/m 0)(1  -/)  L/l, //»,„. 

Using  H(  1)  -  1  and  computing  lim, _,//(>-)  by  applying  L’Hospital’s  rule  to  (39)  results, 
after  algebraic  simplification,  in 

(40)  knlH0( 0)  -  /J0I1  -  [(/3/a  +  /3)  -  -  X,  E™,  Ao  -  X Poo- 

Substituing  (40)  into  (39)  gives 

(41)  H(y)  -  [(a  +  /S)/#]/^,  +  /•{[>  (  1  -.y*)]/U(l  ->>)])  -  (A ,/w/3)  (1  -yA)  I/",  ,/>;0 
Equations  (la)  and  (lb)  can  be  rewritten  as  a 

P,„0  ~  <XP0 0  —  X|  p,„o 

Ao  =  mPp,+\  o  ~  Xip,0  (1  <  /  <  m  -  1) 
which  is  equivalent  (by  induction)  to 

^43)  Pio  “  (M0)-'(aPoo  ~  X|  />„o)  (/“/»,  ot  -  1,  1). 

Using  (42)  to  evaluate  E,™ ()p,0  yields  the  relationship 

(43)  1  -  p  =  [(a  +  0)/0]poo  “  (Xi/m/S)!/!,  ip,0. 

Because  of  (43)  and  (14),  (41)  simplifies  to  (25),  the  expression  for  H(y)  given  in  Sec¬ 
tion  1. 
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ABSTRACT 

the  determination  of  steady-state  characteristics  in  systems  of  tandem 
queues  has  been  left  to  computer  simulation  because  of  the  lack  of  exact  solu¬ 
tions  in  all  but  the  simplest  newtorks.  In  this  paper,  several  methods 
developed  for  approximating  the  average  wailing  time  in  single-server  queues 
are  extended  to  systems  ol  queues  in  series  Three  methods,  due  to  (  raker. 
Page,  and  Marshal,  are  compared  along  with  results  gathered  through  GPSS 
simulation.  Various  queueing  networks  with  Erl  ingian  service  distributions  are 
investigated. 


INTRODUCTION 

Series  queueing  systems,  in  which  the  departure  process  from  one  service  station  forms 
the  arrival  process  at  the  next  service  station,  are  quite  common  in  practice.  Such  systems  have 
been  used  to  represent  inspection  systems,  production  lines,  telephone  networks,  registration 
processes,  and  urban  traffic  situations.  However  mathematical  formulae  only  exist  for  problems 
that  have  restrictive  assumptions  associated  with  them  A  relaxation  of  these  assumptions 
results  in  problems  that  do  not  allow  exact  analytical  solutions. 

For  a  system  with  Poisson  arrivals  and  exponential  service  times,  R.  R.  P.  Jackson  [8] 
found  the  queue  lengths  of  the  service  stations  to  be  independent  variables  in  the  steady  state. 
J  R.  Jackson  [7]  demonstrated  that,  for  this  same  Poisson-exponential  system,  the  steady  state 
joint  probability  distribution  of  customers  waiting  in  the  system  is  equal  to  the  product  of  the 
probabilities  lor  each  individual  Poisson-exponential  service  station. 

Burke  [1]  showed  that  for  each  service  station  in  the  Poisson  input-exponential  service 
system,  the  steady  state  output  process,  and  therefore  the  input  process  to  the  next  station,  is 
also  Poisson.  This  proof  was  supplemented  by  Finch  [4]  who  found  Burke's  Poisson  departure 
to  hold  only  when  infinite  queue  lengths  are  allowed  between  stations.  In  addition  he  proved 
that  successive  interdeparture  intervals  are  independent  in  the  steady  state  only  in  the  case  of 
exponential  service  times  and  unbounded  queue  lengths.  For  general  service  distributions, 
other  considerations  are  necessary  to  determine  the  departure  process  from  each  station  in  the 
series. 

Because  departures  from  one  station  form  arrivals  into  the  next  station,  the  analysis  of 
series  queueing  systems  is  much  more  complicated  than  traditional  analysis  of  ordinary  service 
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stations.  Most  of  the  analytical  work  done  with  series  queueing  systems  has  been  limited  to 
Poisson-exponential  networks.  Further  study  has  been  performed  through  simulation.  For 
example,  Nelson  [13]  estimated  steady-state  queue  statistics  by  simulating  a  two-server  network 
model.  He  considered  the  exponential.  Erlang  with  parameter  2,  and  constant  distributions  as 
arrival  and  service  processess  and  conducted  experiments  for  combinations  of  these. 

Recent  analysis  in  series  queueing  systems  has  turned  to  approximate  solutions  under 
steady  state  conditions.  A  useful  contribution  was  made  by  Fraker  [5]  who  experimentally 
developed  an  approximate  formula  for  the  mean  waiting  time  in  a  system  of  single-server, 
infinite  capacity  queues  with  Erlang  service.  Page  [14]  developed  an  approximation  for  the 
average  waiting  time  in  E,/Ek/s  queues  and  Marchal  [10]  did  the  same  for  Gl/G/  aeues.  In 
this  paper  each  of  these  will  be  extended  to  infinite  capacity  queues  in  series. 

The  purpose  of  this  paper  is  to  compare  these  three  waiting  time  approximations  with 
each  other  and  with  known  analytic  results,  if  they  are  available,  or  simulation  results  ir  the 
cases  where  analytic  results  do  not  exist.  Four  series  queueing  systems  with  diverse  parameters 
are  studied  and  diagramed  in  Figure  1.  The  intention  is  to  show  that  approximation  methods 
can  be  used  effectively  in  the  study  and  analysis  of  queueing  systems  in  place  of  simulation 
whenever  analytic  solutions  do  not  exist.  The  benefits  in  terms  of  savings  in  cost,  time,  and 
trouble  are  quite  obvious. 


Station  1 

Experiment  Our 

Station  2 

N, 

1  tk’ 

Service 

“1 

Service 

Experiment  Two 

Station  1 

Station  2 

Service 


Experiment  Three 

Station  1  Station  2 


H 

Arrivals  _ 

E-, 

E*2 

Service 

Service 

Experiment  Four 

Station  1  Station  2 


Ejl 

Arrivals  ^ 

E«, 

E"2 

■  w 

Service 

Service 

FIGURE  I.  Diagrams  of  the  four  experimental  queueing  systems 

The  choice  of  the  Erlang  and  hyperexponential  families  of  probability  distributions  as 
arrival  and  service  processes  provides  much  greater  modeling  flexibility  than  does  the  exponen¬ 
tial.  In  fact,  the  exponential  is  a  special  case  of  both  the  Erlang  and  hyperexponential.  The 
Erlang  distribution  interpolates  infinitely  many  distributions  between  the  completely  random 
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exponential  and  completely  regular  constant.  The  coefficient  of  variation  of  the  Erlang  distribu¬ 
tions  ranges  from  0  to  1.  The  hyperexponential  represents  distributions  whose  coefficient  of 
variation  ranges  from  1  to  Observing  the  mean  and  variance  of  the  arrivals  and  services  for 
some  system  would  allow  selecting  a  model  to  fit  the  system  from  either  the  Erlang  or  hyperex¬ 
ponential  distributions.  Thus  the  four  systems  chosen  for  study  represent  various  combinations 
from  a  wide  range  of  real-world  systems. 

MATHEMATICAL  AND  EXPERIMENTAL  TECHNIQUES 

The  system  considered  has  two  service  stations  in  series.  Let  A,,  p(,  and  p,  be  the  arrival 
tales,  service  rates,  and  utilization  rates  for  the  two  stations,  for  /« 1,2.  is  assumed  to  be 
known;  under  steady  state  conditions,  the  average  departure  rate  from  the  first  queue  equals  its 
average  arrival  rate,  hence  K2  —  A|  =  A.  The  two  stations  have  Erlang  service  distributions, 
independent  of  each  other  and  of  the  arrival  process,  with  parameters  A ,  and  A2.  The  variances 
of  the  two  service  distributions  are  <r2  =  1/A,p,2  for  /  - 1 , 2  respectively. 

Marshall  [11]  derived  a  relationship  for  Gi/G/\  queues  which  is  often  used  in  this  paper. 
If  <t],  and  crj  are  the  variances  of  the  interarrjval,  service,  and  departure  distributions 
respectively/then  the  average  waiting  time  in  queue,  W<r  is 

(1)  =  (it2  +  2<r2  -  <rj)/2(l  -  p). 


First  we  present  the  three  approximation  techniques  by  considering  a  single  station  sys¬ 
tem.  Their  application  to  service  stations  in  series  is  explained  in  the  next  section  as  each 
experiment  is  discussed.  In  addition,  the  computer  simulation  techniques  are  described. 

(1)  Fraker's  Approximation 

For  the  GI/EJ 1  queueing  system,  crj  is  not  known  exactly,  but  Fraker  found  the  follow¬ 
ing  approximate  expression: 

(2)  a-,2  =  1/yA2  +  (j—\)jp2  +  (1— p)  (j—l)/mjp2  —  (m~\)/mpL2 

+  0.5(1  -p)  (m  —  1)  (j-l)/m2  jp2  +  2(1  — p)  (m-1)  (j-\)/mj2p.2 

where  y  =  (coefficient  of  variation  of  interarrival  times)-2  and  m  =  (coefficient  of  variation  of  ser¬ 
vice  times)  2.  Substituting  <r,2  into  (1),  together  with  the  known  expressions  for  cr2  and  c-2, 
yields  the  average  waiting  time  in  the  queue. 

(ii)  Page's  Approximation 

_Page  developed  an  approximation  for  the  average  waitingjime  in  the  EJEJs  queue.  Let¬ 
ting  Wq  (1 jj,  1  /k)  be  the  average  waiting  time  in  this  queue,  (l,l)  =  average  wailing  time  in 
,  Hyo.l)  =  average  waiting  time  in  D/M/s,  Wq{  1,0)  “average  waiting  time  in  M/D/s, 
and  Wq (0,0)  “average  waiting  time  in  D/D/s,  Page  suggested  that 

Wq(\/j,Mk)  =  (1-1  /j)  (1  —  1/A)  Wq  (0,0)  +  (1-1/./)  (1/A)  ^(0,1) 

+  (Mi)  (\~\/k)Wq  (1.0)  +  (1 U)  (1/A)  Wq  (1.1). 

Since  W„(0. 0)=0,  this  becomes 

(3)  Wq  =  (1-1//)  (1/A)  W,  (0,1)  +  (1 U)  (1-1/A)  Wq  (1.0)  +  (\/j)  (1/A)  ^(1,1). 
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(iii)  MarchaTs  Approximation 

Marchal  found  an  approximate  formula  for  waiting  time  in  07/071  queues  to  be 
(4)  =  l(l  +  l/m)/(l/pJ+l/w)l  |A <rr,'’+(T )/2(  1  — p)] 

where  1/m,  as  before,  is  the  square  of  the  coefficient  of  variation  of  the  service  times. 

(iv)  Simulation  Techniques 

Simulation  results  were  obtained  through  GPSS  simulation  of  the  queueing  system  using 
the  regenerative  method  suggested  by  Crane  and  lglehart  [2].  Independent  and  identically  dis 
tributed  blocks  of  observations  are  created  by  starting  the  simulation  in  the  empty  stale  and  let¬ 
ting  it  return  to  the  empty  state.  All  observations,  transieni  and  steady  slate  ones,  are  averaged 
within  these  regeneration  cycles.  Confidence  intervals  are  found  using  standard  statistical  for¬ 
mulae.  For  the  systems  considered  in  this  paper,  the  number  of  customers  simulated  ranged 
from  15,000  to  25,000  depending  upon  the  utilization  rate  of  the  service  stations. 

It  should  be  pointed  out  that  the  approximation  techniques  used  here  all  assume  that  the 
input  to  the  second  station  in  the  series  is  a  renewal  process.  This  is  not  true.  Results  of  Finch 
[4]  indicate  that  departure  intervals  are  statistically  dependent  random  variables  for  any  system 
other  than  those  with  Poisson  arrivals  and  exponential  service  times.  Later  Disney,  Farrell,  and 
De  Morais  [31  determined  that  the  departure  process  from  an  M/G/ 1  queue  is  a  renewal  pro¬ 
cess  for  some  additional  simple  systems  For  the  series  queueing  systems  considered  in  this 
paper,  arrival  intervals  at  the  second  station  are  statistically  dependent.  However,  the  methods 
applied  here  are  only  approximations,  and  they  do  not  account  for  the  lack  of  independence  in 
the  input  and  output  processes. 

A  report  by  Hiilier  and  Lo  [6]  includes  tables  of  statistics  for  various  hJEjs  systems  with 
small  integer  values  of  j,fc,  and  s.  These  numerical  results,  obtained  through  extensive  compu¬ 
tational  work,  do  not  include  any  of  the  systems  observed  in  this  paper.  In  addition  they  sug¬ 
gest  an  approximation  for  other  systems,  which  is  somewhat  restrictive,  by  extrapolating  out 
from  the  existing  tables  of  data.  This  approximation  is  not  applicable  here  since  the  parameters 
for  the  Erlang  arrivals  into  the  second  station  are  not  any  of  the  integer  values  considered  in 
the  tables.  The  results  of  Hiilier  and  Lo  can  be  useful  in  further  analysis  of  approximation 
techniques. 

RESILTS 

Four  series  queueing  systems  were  studied.  The  specific  experimental  design  was  decided 
upon  w’ith  the  idea  of  choosing  parameters  representing  systems  that  were  realistic  while  at  the 
same  time  selecting  diverse  sets  of  parameters.  In  addition,  the  computing  time  served  as  a 
constraint  on  the  number  of  experiments  that  were  feasible.  For  all  simulation,  the  mean 
interarrival  time,  1/A,  was  held  constant  at  1  time  unit  of  the  simulator.  This  made  determina¬ 
tion  and  control  of  utilization  rates  an  easy  task. 

Experiment  One  —  Mi  Ek  /\  —  !EkJ  1 

The  queueing  system  at  the  first  station  is  a  well  known  case  of  the  M/G/\  system.  In  a 
general  A//G/1  system,  the  average  waiting  time  is  known  from  the  Pollaczek-Khintchine  for¬ 
mula  to  be  p(p2rr  ■  +  1  )/2(l  -  p)p.  If  G  is  an  Erlang  with  parameter  k\,  then 

W7,,  -p,(*i  +  1)/2(1-p,)*iMi- 


(5) 
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Each  of  the  three  approximations  yields  this  exact  result  at  the  first  station.  Furthermore,  for 
the  first  station,  the  variance  of  the  interdeparture  times  is  known.  Jenkins  [9]  proved  it  to  be 

o’,/,  -  ll-(*|— Dpj7k|]/X|2. 

Since  the  output  from  stage  1  is  the  input  for  stage  2,  <r ^  =  <r]^.  However  the  complete  distri¬ 
bution  of  the  interdeparture  times  is  not  known.  Thus  the  second  station  is  a  G/EkJ 1  system. 
G  is  the  interarrival  distribution,  equal  to  the  departure  distribution  from  the  first  station,  with 
mean  I/A  and  variance  o-j;  given  in  (6).  Exact  formulae  for  the  average  waiting  time  for  this 

type  of  system  are  not  available,  thus  WV2  must_be  computed  through  approximations.  The 
total  waiting  time  in  the  system  is  WVt  =  Wq^  +  IF 

Using  Fraker’s  technique,  <rj2  is  approximated  by  (2)  using  m2  =  k2  and  j2  = 

|1  -  ( k ,  -  1)  pi2/*,]-1  which  follows  from  (6).  Substituting  <rj,  in  (1),  where  al  and  a2  are 

2  u2  a2 

known,  gives  the  following  expression: 

wi 2  —  U/2(l  -  p2))  [l/k2n2  -  ( j2  -  \)/j2p2  -  (1  -  p2)  (j2  -  \  )/k2  j2  nl 
W  +  k2  p22-0.5(l-p2)  (A 2 — 1 )  (j2-\)/k2j2  p2 

— 2(1— p2)  ( A 2  1 )  U2—  1  )/k2j2  n2  ] . 

In  applying  Page’s  approximation,  it  must  be  noted  that  the  second  station  in  the  series 
system  is  not  strictly  an  EJEJX  queue,  but  since  (3)  is  an  approximation,  it  is  likely  that  it 
may  be  satisfactory  for  the  G/G/ 1  system  at  the  second  station.  In  order  to  apply  (3)  to  the 
calculation  of  Wv2,  we  set  j  »  [1  — (A | — 1 )  p\/_k |]~'  as  before,  and  k^k-^_  The  waiting  times  of 
the  simple  systems  with  single  servers  are  (1.1)  -  p2/(l-p2)p2,  ^(0,1)  =  v/(l-v)p2 
where  vis  the  root  of  exp[-(l-v)/p]  in  (0,1)  and  IK,  (1.0)  =  p2/2(l-p2)p2.  The  Marchal 
approximation  is  applied  to  the  second  station  with  m=k2  and  the  known  variances  substituted 
in  (4). 

Table  I  compares  the  results  calculated  by  the  three  approximation  techniques  with  those 
obtained  through  simulation,  where  A,  =  10  and  k2  is  allowed  to  vary.  For  this  experiment 
alone,  the  waiting  time  at  each  of  the  stations  along  with  the  total  average  waiting  time  is 
reported.  In  this  way  the  relative  proportion  of  the  total  delay  encountered  at  each  station  can 
be  seen. 

Experiment  Two  —  M/£u/  1  —  •  / Ek}/s 

As  in  Experiment  One,  the  system  at  the  first  station  is  welt  known  and  the  waiting  time 
is  given  in  (5).  A  procedure  is  suggested  by  Rosenshine  and  Chandra  [15]  for  approximating 
the  waiting  time  at  the  second  queue  using  Fraker’s  formula.  They  claim  that  (7)  can  be 
viewed  as  the  average  waiting  time  of  the  M/M/1  system  multiplied  by  a  factor  T,  where 

(8)  Y  -  y[2/A2— (y2-l)/,-2-(l— P2)  (j2-l)/k2j2  +  (k2  -  l)/k2 

-0.5(1  -p2)  (k2-l)  U2— 1)/A22y2— 2  (1-P2)  (A2— 1)  (j2  -  \)/k2j2]. 

Assume  that  (8)  gives  the  ratio  of  the  average  waiting  time  at  station  2  with  s  servers  and  gen¬ 
eral  arrivals  to  the  average  waiting  time  with  s  servers  and  Poisson  arrivals.  To  find  the  average 
waiting  time  at  station  2  with  multiple  servers,  calculate  Y  using  (8)  and  multiply  it  by  the  aver¬ 
age  waiting  time  of  an  M/M/s  system  with  the  same  utilization  rate. 

The  application  of  Page’s  method  is  similar  to  that  in  Experiment  One  where  the  second 
station  is  now  approximated  by  an  EJ Ek/s  queue  using  (3).  Marchal’s  approximation  is  not 
applicable  in  this  case  since  it  is  defined  only  for  single  channel  queues.  Table  II  compares  the 
approximate  and  simulation  results,  where  it,  -  10,  k2  varies,  and  s=10. 
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TABLE  1  —  Average  Waiting  Time  for  M!Ew/\  — *  ■/ EkJ\  System 


-- 

- - 

Simulation 

Pi 

*2 

H',!  W„T 

-  rsj 

1^ 

Point 

Estimate 

W<T 

957"  Confidence 
Interval 

W„T 

0.60 

0.60 

1 

0.495 

0.6% 

1.191 

— 

0.702 

1.197 

- - 

0.686 

— ^ 

1181 

- ■* 

1  202 

II. III.  1.2901 

0  80 

0.60 

' 

1  760 

0.537 

2.297 

0.547 

2.307 

0.519 

2.279 

2.265 

[2.031.2.4761 

0.60 

0  60 

10 

0.495 

0.270 

0.765 

0.344 

0.839* 

0.340 

0.835 

0.779 

(0  720.0.83X1 

0.80 

0.60 

10 

1.760 

0  142 

1.902 

0.226 

1.986 

0.220 

1 .980 

1.828 

II. 604.2.0311 

0.60 

0.80 

1 

0.495 

2.578 

3.073 

2.602 

3.097 

2.568 

3063 

3.414 

|2  985.3  8401 

0.80 

0  80 

1 

1.760 

2.094 

3.854 

2.137 

3.897 

2.076 

3.836 

4.325 

13.722.4.8501 

0.60 

0  80 

10 

0.495 

1.100 

1.595* 

1.234 

1.729 

1.224 

1.719 

1.925 

[1.657.2.1921 

0  80 

0.80 

10 

1.760 

0.671 

2.431 

0.824 

2.584 

0  807 

2.567 

2.478 

|2.I85.2.140| 

t All  three  approximations  yield  this  exact  result. 

“Indicates  that  the  approximation  lies  outside  the  confidence  interval. 


TABLE  II  —  Total  Average  Waiting  Time  (WqT)  for 
M/E|0/l  —  -/E^/IO  System 


Simulation 

Pi 

P2 

^2 

Fraker 

Page 

Point 

Estimate 

95%  Confidence 
Interval 

0.60 

0.60 

l 

0.507 

0.506 

0.518 

[0.492,0.543] 

0.80 

0.60 

l 

1.769 

1.767 

1.764 

[1.550,1.958] 

0.60 

0.60 

10 

0.500 

0.502 

0.513 

[0.469,0.557] 

0.80 

0.60 

10 

1.762 

1.764 

1.767 

[1.545,1.968] 

0.60 

0.80 

1 

0.627 

0.621 

0.655 

[0.618,0.690] 

0.80 

0.80 

1 

1.867 

1.857 

1.899 

[1.684,2.094] 

0.60 

0.80 

10 

0.551* 

0.561* 

0.598 

[0.568,0.628] 

0.80 

0.80 

10 

1.794 

1.803 

1.861 

[1.580,2.0011 

WAITING  TIME  IN  SERIES  QUEUEING 


505 


Experiment  Three  —  H/EkJ  1  — >  •  / EkJ\ 

The  hyperexponential  distribution,  as  defined  by  Morse  [12],  has  coefficient  of  variation, 
c,  greater  than  I.  Only  Fraker  and  Marchal's  approximations  can  be  applied  to  this  system. 

Using  Fraker’s  approximation,  a2^  is  found  from  (2)  where  j\  -  Me2  and  m^  «  fc,. 
Knowing  that  ir2t  —  c2/k2  and  rr*  -  l/k^2,  Wq (  is  found  using  (1).  Since  o-*,—  oJt,  j2  can 
be  calculated.  For  o-j2  is  found,  and  with  known  expressions  for  <r]7  and  <r2} ,  Wq2  is 

also  determined  using  (1). 

Marchal’s  approximation  yields  Wq]  when  the  appropriate  expressions  are  substituted  into 
(4).  With  the  waiting  time  approximated,  and  o-^  and  known,  (1)  can  be  used  to  solve  for 
<r,/r  This,  in  turn,  defines  <r2: ,  and  with  other  values  known,  (4)  determines  Wqy 

In  this  experiment,  the  arrivals  into  the  first  station  are  hyperexponential  with  c=2. 
These  results  are  presented  in  Table  III.  For  the  systems  where  the  first  station  had  Erlang  ser¬ 
vice  with  parameter  10,  Fraker’s  approximation  gave  negative  waiting  times  at  the  second  sta¬ 
tion.  This  failure  in  the  approximation  formula  is  indicated  in  the  table  with  blanks. 


TABLE  III  —  Total  Average  Waiting  Time  (WqT) 
for  H/ Ek (/l  —  7£tj/l  System 


— 

Simulation 

P\ 

Pi 

*2 

. 

Fraker 

Marchal 

Point 

Estimate 

95%  Confidence 
Interval 

0.80 

1 

0.60 

1 

10.298* 

10.389* 

9.077 

[7.688,10.180] 

0.80 

10 

0.60 

1 

7.913* 

6.487 

[5.762,7.083] 

0.80 

1 

0.60 

10 

10.169* 

9.863* 

8.545 

[7.354,9.541] 

0.80 

10 

0.60 

10 

7.427* 

6.008 

[5.276,6.613] 

0.80 

1 

0.80 

1 

13.496 

13.539 

12.313 

[10.053,13.691] 

0.80 

10 

0.80 

1 

10.779* 

9.642 

[8.313,10.695] 

0.80 

1 

0.80 

10 

12.546* 

11.903 

11.127 

[9.747,1 2.249] 

0.80 

10 

0.80 

10 

9.209* 

7.401 

[6.451,8.177] 

'Indicates  that  the  approximation  lies  outside  the  confidence  interval.  Blanks  indicate  a  lailure  in  the  approximation 
formula  to  yield  values. 
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Experiment  Four  —  E,\/EK  |/1  —  / EkJ\ 

Fraker’s  formula  (2)  is  used  for  a  given  value  of  j\  and  =  k\  to  determine  oj .  Here 
<rj;  —l/j tX2  and  l/Ar^?  so  that  Wql  is  found  from  (1).  This  provides  the  appropriate 
information  to  find  Wql  as  in  Experiment  Three. 

Page’s  approximation  in  (3)  yields  Wql.  As  before,  with  Wq]  approximated,  o-j)  and 
known,  (1)  is  used  to  determine  a j  .  Page  approximates  the  arrivals  to  the  second  station  by 
an  E,  distribution  with  variance  l/y'jA2.  Since  o-j  =«rj2,  j2  can  be  found  and  used  to  calculate 
Wq2.  For  Marchal’s  approximation,  (4)  is  applied  to  find  Wql.  This  is  used  together  with  (1) 
to  yield  <rj  as  in  Experiment  Three,  which  then  allows  determination  of  WQ }  using  (4)  again. 
Table  IV  shows  the  approximations  together  with  simulated  results.  Here  the  parameter  of  the 
Erlangian  arrival  distribution  into  the  first  station, ,  is  10. 


TABLE  IV  —  Total  Average  Waiting  Time  (Wl/T)  for 
E\q /£*/!  — *  / Ek  J 1  System 


■ 

■ 

Simulation 

P\ 

D 

P2 

H 

Fraker 

Page 

Marchal 

Point 

Estimate 

95%  Confidence 
Interval 

0.80 

1 

0.60 

1 

2.240 

2.295 

2.213 

2.303 

[2.1 15,2.471] 

0.80 

10 

0.60 

1 

0.583 

0.652* 

0.589 

0.588 

[0.547,0.626] 

0.80 

1 

0.60 

10 

1.814 

1.924 

1.845 

1.953 

[1.500,2.366] 

0.80 

10 

0.60 

10 

0.272* 

0.377* 

0.346* 

0.252 

[0.236,0.267] 

0.80 

1 

0.80 

1 

4.271* 

4.304* 

4.258* 

3.840 

[3.512,4.116] 

0.80 

10 

0.80 

1 

1.770 

1.853 

1.753 

1.822 

[1.631,1.995] 

0.80 

1 

0.80 

10 

2.793 

2.916 

2.877 

2.684 

[2.160,3.155] 

0.80 

10 

0.80 

10 

0.498’ 

0.610* 

0.575* 

0.456 

[0.433,0.479] 

‘Indicates  that  the  approximation  lies  outside  the  confidence  interval. 


CONCLUSIONS  AND  RECOMMENDATIONS 

Comparative  experiments  were  run  using  three  approximation  formulae  for  the  waiting 
time  in  the  two-stage  series  queueing  system.  Table  V  shows  the  relative  performance  of  each 
of  the  approximation  techniques  by  comparing  it  to  the  waiting  time  found  through  computer 
simulation.  For  each  experiment,  the  %  deviations  and  average  absolute  %  deviations  are 
shown.  Table  VI  summarizes  each  of  the  techniques  in  terms  of  overall  average  absolute  % 
deviation  and  the  percentage  of  times  the  approximate  value  fell  within  the  95%  confidence 
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TABLE  V  —  %  Deviation  in  Waiting  Time  of  Approximate 
Value  from  Simulated  Value 


Run 

EXPERIMENT  1 

EXPERIMENT  2 

Fraker 

-Pj*e 

Marchal 

Run 

Fraker 

Page 

—  ■  H 

~~  -o"% 

-0.48 

-1.82 

i 

-2  16 

-2  36 

2 

1  40 

1.85 

0.59 

2 

0  30 

0.19 

3 

—  1.79 

7.73 

7.25 

3 

—2  58 

—2  16 

4 

4.05 

8.69 

8.32 

4 

-025 

-0.14 

S 

—9  98 

-9  28 

-1028 

5 

-4.31 

-5.16 

6 

-10.90 

-9.91 

-11.31 

6 

—  1.67 

-2.19 

7 

-17  12 

-kO  20 

-10.70 

7 

-7.83 

-6.19 

8 

-1.90 

4  28 

3  59 

8 

-3.57 

-3  09 

Average 

Absolute  'Hi 

6.01 

6.55 

6.73 

2  83 

2.69 

Deviation 

EXPERIMENT  3 

EXPERI 

MENT  4 

Run 

Fraker 

Marchal 

Run 

Fraker 

Page 

Marchal 

1 

13.46 

14.46 

1 

-2.70 

-0.34 

-3.88 

2 

21.99 

2 

-0.79 

II  02 

0.16 

3 

19.00 

15.42 

3 

-7,09 

-1.46 

-5.53 

4 

23.62 

4 

8.21 

49.97 

37.32 

5 

961 

9  95 

5 

11.23 

12.09 

10  90 

6 

11.79 

6 

—2.82 

1.72 

-3.76 

7 

12.75 

6.97 

7 

4.05 

8  64 

7.18 

8 

24.42 

8 

9.11 

33.68 

25.94 

Average 
Absolute  % 

13.71 

16.08 

5.75 

1487 

II  83 

Deviation 

_ 

Blanks  indicate  a  failure  in  the  approximation  formula  to  yield  values. 


TABLE  VI  —  Summary  of  Approximation  Techniques 
for  Experiments  I  and  4 


Technique 

Overall  Average 
Absolute  %  Deviation 

%  in 

Confidence  Interval 

Fraker 

5.88 

75.00 

Page 

10.71 

68.75 

Marchal 

9.28 

81.25 
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interval  determined  by  simulation.  Only  the  results  of  Experiments  1  and  4  are  included  in  this 
table,  since  they  cover  all  three  techniques. 

Each  of  the  techniques  was  shown  to  have  its  limitations.  Page’s  formula  could  not  be 
applied  to  hyperexponential  arrivals,  Marchal’s  limited  to  a  single  channel  at  any  stage,  and 
Fraker’s  broke  down  under  certain  cases  where  the  system  had  hyperexponential  arrivals.  How¬ 
ever,  it  is  apparent  from  the  results  shown  here  that  the  approximations  can  be  successfully 
used  in  studying  queueing  systems  when  analytic  solutions  are  not  available.  Overall,  one  can 
conclude  that  for  series  queueing  systems  with  either  exponential  or  Erlang  interarrivals  and 
service  times,  Fraker’s  approximation  formula  yields  the  best  results.  This  is  true  for  both  sin¬ 
gle  and  multiple  servers.  When  the  queueing  system  has  hyperexponential  arrivals,  Marchal’s 
formula  should  be  applied  to  obtain  approximate  results. 

If  Experiment  Three  is  disregarded,  the  values  obtained  from  each  of  the  approximations 
are  very  close  to  each  other,  and,  in  most  cases,  consistent  with  respect  to  their  position  in  the 
confidence  interval  found  through  simulation.  It  appears  as  if  the  three  approximations  either 
underestimate  or  overestimate  the  actual  value.  This  could  be  due  to  the  influence  of  statistical 
dependency  in  the  service  stations’  arrival  and  departure  processes.  Investigation  of  the  waiting 
time  data  gathered  in  each  of  the  four  experiments  failed  to  yield  any  conclusive  statements 
about  this  dependency.  It  would  be  interesting  to  see  if  these  consistencies  in  the  approxima¬ 
tion  results  are  general  to  other  cases  as  well.  Any  future  work  that  can  account  for  the  pres¬ 
ence  of  statistical  dependence  in  the  input  and  output  of  the  service  stations  will  certainly  lead 
to  improved  approximation  techniques. 

All  too  often  the  systems  analyst  resorts  to  simulation  to  study  queueing  systems  when 
analytic  solutions  do  not  exist.  Approximation  techniques  have  been  shown  to  be  a  useful  tool 
in  the  study  of  queueing  networks  and  can  be  used  for  deriving  information  on  all  system  per¬ 
formance  measures.  Future  research  should  develop  better  approximations  that  have  applica¬ 
tion  to  all  types  of  complex  queueing  systems  and  ultimately  provide  an  attractive  alternative  to 
simulation.  Approximation  techniques  should  be  put  to  increasing  use,  especially  in  the  appli¬ 
cation  of  queueing  analysis  to  real  world  situations  involving  complex  queueing  systems. 
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ABSTRACT 

From  an  original  motivation  in  quantitative  inventory  modeling,  we  develop 
methods  lor  testing  the  hypothesis  that  the  service  limes  of  an  M/G/l  queue 
are  exponentially  distributed,  given  a  sequence  of  observations  of'  customer  line 
and/or  system  wails.  The  approaches  are  mostly  extensions  of  the  well-known 
exponential  goodness-of  fit  test  popularized  by  Gnedenko,  which  results  from 
the  observation  (hat  the  sum  of  a  random  exponential  sample  is  Erlang  distri¬ 
buted  and  thus  that  the  quotient  of  two  independent  exponential  sample  means 
is  /  distributed. 


INTRODUCTION 

As  is  discussed,  for  example,  in  the  final  chapter  of  Hadley  and  Whitin  [8],  it  is  impera¬ 
tive  that  data  be  collected  for  any  quantitative  inventory  analysis  in  order  to  obtain  (possibly 
estimated)  values  of  model  parameters  and  functions  before  it  is  at  all  feasible  to  find  an 
"optimal"  operating  doctrine.  Even  if  there  is  a  satisfactory  mathematical  model  available,  its 
solution  may  be  prevented  by  an  inability  to  observe,  much  less  calculate,  its  key  variables. 

It  turns  out  that  numerous  inventory  systems  can  be  formulated  as  functions  of  a  reorder 
queueing  problem.  That  is,  the  reorder  fulfillment  facility  acts  as  a  server  to  a  demand  stream 
related  or  even  identical  to  the  underlying  demand  on  the  inventory,  as  shown  in  Figure  1.  If, 
for  example,  the  inventory  manager  is  able  only  to  observe  the  amounts  of  time  it  takes  for 
reorders  to  return  to  stock  (i.e.,  the  leadtimes),  then  it  is  likely  that  a  solution  to  the  inventory 
model  will  not  be  possible.  By  virtue  of  the  presentation  of  the  queueing  subsystem,  this  would 
then  be  analogous  to  trying  to  solve  a  waiting-line  model  given  information  only  on  its 
sequence  of  customer  waiting  times. 

In  some  earlier  work  by  Gross,  Harris,  and  Lechner  [7],  and  Gross  and  Harris  [5),  [6], 
stochastic  inventory  models  were  studied  which  made  use  of  the  relationship  between  the 

•This  work  was  supported  by  the  Office  of  Naval  Research  under  Contract  No.  NOO0I4-67-A-O2I4,  while  the  authors 
were  with  The  George  Washington  University.  Special  thanks  to  the  referees  for  many  helpful  suggestions. 

••This  author's  contribution  was  based  upon  a  dissertation  submitted  to  the  School  of  Engineering  and  Applied  Science 
of  the  George  Washington  University  in  partial  fulfillment  of  the  requirements  for  the  degree  of  Doctor  of  Science 
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DEMAND  FOR  ONUS 


Figure  1.  Inventory  system 


reorder  queue  and  the  overall  inventory  system.  For  example,  the  authors  of  f5)  study  several 
one-for-one  ordering  (continuous-review  (s,5)  policies  where  s  =  S-l)  inventory  models  in 
which  the  time  required  for  order  replenishment,  or  the  reorder  leadtime,  depends  on  the 
number  of  orders  outstanding.  Demand  on  the  inventory  system  is  assumed  to  be  a  Poisson 
process  with  constant  mean  rate,  and  the  model  is  then  solved. 

When  the  continuous  review  (5-1,  S)  problem  is  examined  more  carefully,  we  see  a 
direct  one-to-one  relationship  between  the  inventory  state  probabilities  and  those  of  the  reorder 
queue,  and  it  is  easy  to  see  that  the  reorder  leadtimes  correspond  to  the  system  waiting  times  of 
an  M/G/l  queue.  In  order  to  complete  the  inventory  analysis,  it  thus  becomes  essential  to 
determine  the  nature  of  the  arbitrary  distribution  associated  with  order  refills,  that  is,  to  find  G, 
which  may  have  to  be  done  using  only  successive  values  of  the  leadtime  or  some  other  similar 
empirical  data.  Therefore  it  seems  that  a  very  natural  problem  which  may  arise  in  this  context 
is  the  determination  of  a  test  (or  tests)  of  the  hypothesis  that  the  order  fulfillment  facility  func¬ 
tions  according  to  specified  distribution  such  as  the  exponential.  But  this  is  precisely  the  prob¬ 
lem  of  testing  the  hypothesis  that  G  =  M  for  an  M/G/l  queue  given  a  sequence  of  observed 
waiting  times.  Of  course,  the  analysis  detailed  in  the  following  could  be  used  to  evaluate  the 
service  mechanism  of  any  M/G/l  queue,  whether  from  an  inventory  model  or  otherwise. 

We  do  not  mean  to  imply  by  our  model  and  its  analysis  that  we  are  now  able  to  handle 
statistically  the  most  complex  queueing  and  inventory  structures.  Rather,  this  is  but  one  step 
to  provide  the  capability  of  making  statistical  inferences  about  probabilistic  models  in  operations 
research  given  very  limited  information  on  their  system  behavior. 

THE  ANALYSIS 

The  object  of  this  paper  then  is  the  development  of  r.ethods  for  testing  the  hypothesis 
that  the  service  times  of  an  M/G/l  queue  are  exponentially  distributed,  given  a  sequence  of 
observations  of  customer  line  and/or  system  waits.  It  turns  out  that  the  approaches  are  mainly 
variations  on  the  well-known  exponential  test  theme  popularized  by  Gnedenko  (for  example, 
see  [4]). 

The  Gnedenko  test  is  as  follows.  Suppose  (r , ,  r2,  ,  t„ )  is  a  random  sample  of  size  n 

from  a  hypothesized  exponential  distribution,  and  let  Or,.  x2 . .v„)  be  the  order  statistics 

obtained  from  the  original  sample.  Then  we  define  the  /  th  normalized  spacing  as 
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s,  =  («—/+!)  (x  —  with  x„  =  0. 

It  is  a  well-known  result  that  the  s  are  exponentially  distributed  (with  the  same  parameter) 
whenever  the  t,  are.  Therefore,  after  the  data  are  split  into  two  groups  of  sizes  (r)  and  ( n-r ), 

Y.sjr 

(!)  Q(r,  n-r) - - - 

X  s„ /(n-r) 

/-/■  + 1 

is  distributed  as  an  /"with  2rand  2 (n—r)  degrees  of  freedom. 

The  proof  of  this  assertion  is  fai/ly  simple.  We  have  the  ratio  of  two  Erlang  random  vari¬ 
ables  in  (1).  But  an  Erlang  variable  can  be  reduced  to  a  chi-square  variable  by  a  suitable 
transformation  and  the  ratio  of  two  chi-square  random  variables  divided  by  their  degrees  of 
freedom  follows  an  /'distribution,  in  this  case  with  2r  and  2 (n-r)  degrees  of  freedom.  We 
may  therefore  test  for  exponentiality  by  requiring  Q(r,n-r)  to  fall  within  an  appropriate  a- 
level  rejection  region  based  on  the  F.  Furthermore,  this  approach  can  still  be  used  even  in  the 
event  the  observed  data  come  from  a  censored  or  hypercensored  sample,  as  explained  in  (1], 
[4],  and  [9}.  This  test  has  been  shown  to  be  quite  powerful  against  an  extremely  wide  range  of 
feasible  alternative  hypotheses  ((31,  [9]),  at  worst  requiring  a  careful  choice  of  r  for  splitting 
the  data.  Special  guidance  for  choosing  r  is  provided  in  [9]  and  (111  where  the  emphasis  is  on 
using  the  shape  of  the  alternative’s  hazard  rate. 

For  purposes  of  analysis,  this  work  has  been  broken  up  into  two  main  problems  and  then 
further  into  a  number  of  subproblems.  The  organization  is  thus  as  follows: 

I.  Line  wait  data  available 

A.  No  line  waits  observed  to  be  zero 

1.  no  parameters  known 

2.  at  least  one  parameter  known 

B.  Some  line  waits  zero 

1.  no  parameters  known 

2.  at  least  one  parameter  known 

II.  System  wait  data  available 

A.  No  line  waits  zero 

B.  Some  line  waits  zero 

C.  No  information  whatsoever  regarding  line  waits 

For  all  problems,  the  queues  are  assumed  to  be  stationary  but  possibly  in  heavy  traffic  and 
the  input  stream  Poisson  with  unknown  rate  A  unless  specified  otherwise. 
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The  Line-Wail  Problem  (I) 

To  begin,  suppose  we  have  a  queue  and  are  able  to  observe  the  line  waits  of  successive 
customers,  say  . ff'J"1,  and  also  know  that  the  interarrival  times  are  indepen¬ 

dent  and  identically  distributed  exponential  random  variables,  it  is  (hen  desired  to  test  the 
hypothesis  that  the  service  distribution  is  exponential.  In  short,  given  the  line  waits  for  an 
M/G/l  queue,  how  do  we  test  the  hypothesis  that  G  =  M,  in  the  notation  of  queueing?  The 
main  difficulty  that  arises  is  the  fact  that  the  line  waits  of  any  queue  are  correlated  to  each 
other,  so  we  must  find  a  way  to  remove  the  correlation  first  before  we  can  deal  with  these  types 
of  data  in  any  reasonably  conventional  way.  The  problem  is  even  more  complicated  if  some  of 
the  line  waits  are  zero,  which  is  naturally  to  be  expected. 

For  any  single  channel  FIFO  (first-in,  first-out)  queue,  the  relationship  between  the  line 
waiting  times  of  the  n  th  and  (n  +  l)sr  customers,  say  and  is  given  by 

(2)  W'„,"+n  =  max  (0,  tVjH}  +  S'"'  -  T,n) ) 

where  S1"1  is  the  service  time  of  the  n  th  customer  and  7'(")  is  the  time  between  the  arrivals  of 
the  nth  and  (n-Fl)sr  customers.  We  can  note  immediately  that  the  stochastic  process 

[Wj"\n  =  1,2,3 . |  is  a  discrete-time  Markov  process  since  the  behavior  of  +  is 

only  a  function  of  the  stochastically  determined  value  of  W^'\  and  is  independent  of  the  prior 
waiting  time  history.  Thus  the  successive  first  differences  of  the  process  will  be  independent 
and  identically  distributed  (IID). 

CASE  A:  Let  us  first  discuss  the  simple  case  in  which  none  of  the  line  waits 

Wj"1,  h  — 1,  2,  3 .  is  zero  (and  cannot  be,  as  in  extremely  heavy  traffic).  Then  from 

Equation  (2)  we  have 

(3)  fF„(,,+n  -  tVj"1  =  S,n)  -  T,n), 

where  the  quantities  (S'"*  -  7'("1)  are  thus  IID.  Under  the  null  hypothesis  of  G  =  M,  the 
queue  is  an  M/M/1,  and  since  the  interarrival  and  service  times  are  exponentially  distributed, 
the  densities  of  T and  S  would  be  given  by 


/i ( z )  =  ke  Kl  (/  >  0) 
f2(s)  =  /ue-MS(s  >  0) 


Then  the  marginal  distribution  function  of  Y»S—T can  be  derived  as 


(5) 


G(y) 


1- 


X 

k+n 


e 


0<0) 

0>0) 


Hence  it  follows  that  if  we  are  given  the  line  waits  of  successive  customers  from  the  M/G/I 
queue,  we  can  test  the  hypothesis  G  =  M  by  taking  the  first  differences  of  the  line  waits  and 
testing  whether  these  differences  have  come  from  the  distribution  G(.v)  given  by  Equation  (5). 
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It  is  easy  to  see  from  Equation  (5)  that1 
(6)  Pr  {  Y  >  0)  =  A/(X+m> 


and 

(7)  Pr  [Y  <  0)  =  n/(k+n) 

and  thus  that  the  conditional  densities  of  >',  given  that  .»  >  0  or  \  <  0,  are 

(8) 

(9)  #(.v|>  >0)  =  m  expl-jp] 

g0'|>,<0)  =  X  expl.vX] 

Equations  (8)  and  (9)  suggest  that  if  we  are  given  a  sample  and  asked  to  test  whether  the  sam¬ 
ple  could  have  come  from  the  distribution  of  the  difference  of  two  exponentials,  we  can  split 
the  data  into  two  groups,  one  consisting  of  the  positive  observations  and  the  other  consisting  of 
the  negative  numbers;2  then  we  test  for  exponentiality  separately,  using  the  /’test  for  each,  set¬ 
ting  the  Type  I  error  with  appropriate  care. 

To  be  somewhat  more  specific  on  the  formalities  of  the  testing  process,  it  should  be  noted 
that  though  there  are  two  separate  independent  exponential  tests,  there  is  really  only  one  true 
hypothesis  to’be  tested,  namely,  that  both  exponentials  are  valid,  with  the  alternative  that  either 
one  or  both  of  the  sub-hypotheses  is  invalid.  If  a  is  the  Type  I  error,  then  we  see  that 


«  =  Pr  {rejection  of  Hu  |  Hn  true} 

=  /Vfrejection  of  either  or  both  of  the  exponentialslboth  true} 
=  /V{rejection  of  first  (say  £,)|  &  Ki  true} 

+  ^{rejection  of  second.  g2 1  £1  &  X':  true} 

—  ^/-{rejection  of  g,  and  g2 1  -.'1  &  £2  lruel 


It  seems  appropriate  to  assume  that  the  third  term  of  the  RHS  is  (approximately)  zero  since 
that  joint  event  is  unlikely.  Hence 

a  =  ttj  +  O;. 


Thus  with  a  =  .05,  it  would  seem  logical  to  let  ai  =  a2  =  a/2.  This  is  further  supported  by 
the  observation  that  the  expected  numbers  of  positives  and  negatives  are  equal  when  p  —  1 
since 

Pr\ Y  >  0}  =  X/(X  +  p)  =  p/(p  +  1)  —  1/2. 


Later  on  in  the  paper,  it  will  be  possible  for  p  «  1.  in  which  case  the  numbers  of  positives 
would  not  equal  that  of  the  negatives.  It  is  still  true  that  the  errors  will  be  additive,  but  the  size 
of  the  sub-samples  will  greatly  affect  the  width  of  the  acceptance  region.  Nevertheless,  both 
sub-hypotheses  must  be  accepted  for  the  global  one  to  be  true,  so  that  the  acceptance  region  is 
defined  in  R 2  space  as 


[u>) 

Pr  {«, 


|«i  <  x  <  h |,  a2  <  y  <b2,  and 
<  X  <  ft|)  =  Pr\a2  <  y  <  />21  =  1  “ ar/2 j . 


Nme  thill  »  is  zero  with  probability  equal  to  zero,  we  shall  not  thus  include  such  a  possibility  in  the  subsequent  proba¬ 
bility  calculations 

2  ft  should  be  recognized  that  t  might  be  zero  in  a  real  problem  if  the  computations  arc  not  carried  out  to  am  great 
level  of  accuracy.  In  such  cases  it  is  probably  best  to  assign  the  zero  random!)  to  cither  of  the  two  groups. 
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Note  that  we  proceed  through  the  entire  test  without  any  knowledge  whatsoever  of  the 
actual  values  of  X  and  m  If,  however,  values  of  X  and  m  are  required,  then  their  maximum- 
likelihood  estimates  are  given  by 


-  _  Sum  of  positive  v  s 
lK  Number  of  positive  y's 
=  Sum  of  negative  y’s 

( "  *  M  Number  of  negative  y's 

On  the  other  hand,  suppose  instead  that  fj.  and/or  X  is  specified.  The  unspecified  parameter  (if 
there  is  one)  is  handled  exactly  as  in  the  preceding  consistent  with  Equations  (8)  and  (9).  But 
if  (for  example)  m  is  known,  then  Equation  (8)  says  that  the  positive  values  of  y  should  follow 
a  known  exponential  distribution.  Hence  their  mean  is  Erlang  distributed  and  we  can  then  con¬ 
struct  a  suitable  rejection  region  for  the  problem.  This  latter  test  should  be  done  with  some 
caution  since  its  power  is  very  much  dependent  upon  the  class  of  possible  alternative 
hypotheses.  This  approach  is  uniformly  most  powerful  against  another  exponential  as  alterna¬ 
tive,  but  might  have  to  be  modified  against,  for  example,  a  gamma  alternative. 

Of  course,  there  have  been  other  tests  posed  for  exponentially,  inluding  those  working 
from  the  empirical  CDF  (exemplified  in  the  work  of  Durbin  [2]),  rank-type  tests  (proposed  ori¬ 
ginally  by  Proschan  and  Fyke  [10]),  and  others  built  upon  special  characterizations  of  the 
exponential  culminating  in  the  recent  work  ol  Wang  and  Chang  [12]).  However,  we  stayed 
with  the  ratio  test  in  view  of  its  very  desirable  properties  as  noted  in  [9],  namely,  good  power 
results  when  handled  properly,  ability  to  handle  all  levels  of  censoring,  ease  of  computation, 
etc. 


CASE  B:  Now  let  us  discuss  the  case  in  which  some  of  the  fine  waits 
[W'"',  /;  =  1 , 2 .  ...  ]  could  be  zero.  When  a  is  indeed  zero,  it  means  that  the  associated 

customer  goes  straight  into  service  and  that  the  service  facility  had  been  idle  from  the  time  of 
departure  of  the  previous  customer  (at  least)  until  his  arrival.  This  implies  that  the  first 
difference  [  is  bounded  below  by  [S'"’  -  T("'],  that  is. 

(12)  W^"+n  -  W]"’  >  S(n)  -  P"\ 

and  furthermore  that  we  may  write 

(13)  Su,)  -  Ttin  =  H,Jn  +  11  -  Wjn'  - 

where  is  the  time  (>  0)  for  which  the  server  is  idle  within  the  n  th  waiting  epoch. 

The  difficulty  here  is  that  every  time  the  server  is  idle,  we  do  not  know  the  exact  duration 
of  its  idle  time,  though  we  do  have  the  number  of  { which  are  zero.  But  at  least  we  can 
find  some  related  limits  and  expectations.  Since  the  queue  is  M/G/l.  successive  idle  periods 
are  IID  exponentials  with  the  same  mean  X'1  as  that  of  the  interarrival  times.  Thus  X  may  be 
estimated  (call  it  X)  by  the  observed  input  rate1.  We  then  recommend  a  heuristic  alteration  of 
the  fundamental  test  statistic  whereby  X'1  is  used  for  each  I'"'  >  0.  So  in  the  event  that 
+  =  o  we  have 


1  If  this  is  no1  available,  i lien  we  suggest  the  lollowing  approach.  Consider  the  percentage  ol  !**,,"  )  equal  lo  zero  as 
an  estimator  of  I  -<>  (say  I  p>  and  equate  it  lo  l-i/A-  Then  lake  the  average  line  wait  Isay  lf„>  andjet  dial  equal  lo 
a/(//'m-a>>  The  simultaneous  solution  of  these  would  provide  the  necessary  value  of  v  namely,  x  -  i>  d  If  I  r* >  1 
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S'"'  -  Pn)  -  W/J"+n  -  tvj " '  -  1/A 

(14) 

=  )F„""  -  1/A. 

Therefore,  given  the  line  waits  from  the  M/G/l  queue,  we  can  find  the  values  of  the 
[S'"'  —  r1"1]  by  using  either  Equation  (3)  or  Equation  (14),  depending  upon  whether  W-'J"*11 
is  positive  or  zero,  and  then  carry  out  the  test  of  hypothesis  on  the  positives  and  negatives  as 
described  before.  It  is  important  to  use  two  distinct  estimators  of  A  (say  A,  and  A:)  for  the 
numerator  and  denominator  of  the  test  statistic,  respectively,  with  each  computed  from  the 
appropriate  portion  of  the  data. 

This  is  clearly  an  approximate  procedure  though  it  is  true  that  the  average  of  times  calcu¬ 
lated  for  both  the  numerator  and  denominator  of  the  Q  ratio  formed  according  to  Equation  (1) 
will  indeed  converge  to  1/A  rather  rapidly  because  the  actual  sequence  {/‘"’I  obeys  the  strong 
law  of  large  numbers  for  UD  exponentials.  To  assess  the  quality  of  the  approximation  we  ran 
some  limited  Monte  Carlo  tests  for  a  few  stationary  queues  using  moderate  to  high  values  of 
the  traffic  intensity  p  and  with  varying  sample  sizes.  Some  results  are  presented  in  the  follow¬ 
ing  table  for  one  such  set  of  runs.  For  this  we  made  100  runs  of  an  M/M/1  simulator  with  100 
customers,  and  1/X  =  120  and  1  //x  =  90.  For  each  run  we  computed  the  values  of  A(  and  \2 
and  used  them  in  the  computation  of  the  test  statistics  wherever  appropriate.  Since  the  number 
of  negative  values  of  —  T'"’]  must  greatly  exceed  the  number  of  positives,  we  worked 
only  with  the  negatives  and  tested  them  for  exponentiality. 


TABLE  1.  Comparison  of  Empirical  Simulation  Ratio 


Statistic  to  F  Critical  Values  (p  —  3/4,  ;V=  100) 

_ Ij 

.01  .02  03  04  |  .05  |  .06  j  .07  T  08 

09 

.10 

Simulation 

.508  .515  .556  576 

.598  1  .614  |  .637  j  .646 

67 1 

.683  1 

F 50. 50 

.514  .555  584  606 

625 

.642  i  .656  j  .670 

.682 

.693 

Approx.  95% 

(  508. 

(.515,  !  (.515.  (.556. 

(  556. 

t  5  6. 

Confidence 

I 

Interval  for 

.671) 

.683)  |  696)  .702) 

.715) 

.728'  1 

Simulation 

i 

'H.-ilcs 

_ ^  ' 

L _ 1 

From  the  theory  of  order  statistics  we  were  able  to  construct  confidence  intervals  from 
repeated  runs  for  the  5%  or  95%  points  (or  any  other,  one  at  a  time)  of  the  empirical  ratio 
statistic.  It  turned  out  that  the  comparable  F-distribution  critical  points  fell  within  these  inter¬ 
vals,  and  thus  we  conclude  that  it  is  statistically  legitimate  to  use  the  /'-distribution  for  any 
related  testing  problem.  When  the  sample  size  is  fixed,  the  effectiveness  of  the  approximation 
would  improve  as  p  gets  closer  to  1. 

The  key  result  which  permits  this  to  be  accomplished  is  the  fact  that  the  order  statistics  of 
a  random  sample  from  (/(0, 1)  each  have  a  beta  distribution  and  that  the  joint  CDF  of  any  two 
is  an  ordered  bivariate  Dirichlet  distribution.  Thus  the  confidence  coefficient  of  any  confidence 
interval  for  an  arbitrary  percentile  for  the  empirical  ratio  statistic  may  be  computed  using 
incomplete  beta  functions  where  the  incomplete  beta  function  may  then  be  converted  easily 
into  the  more  easily  handled  binomial  sum. 
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The  Systein-Wait  Problem  (11) 

The  second  problem  that  was  considered  is  similar  to  the  first  one,  except  that  we  are 
given  the  system  waiting  time  of  each  customer  of  an  M/G/l  queue  as  opposed  to  the  line 
waits  of  the  previous  problem  Again,  these  system  wails  are  correlated  to  each  other  and  so 
they  are  not  easy  to  handle.  The  problem  is  more  difficult  if  we  do  not  know  anything  about 
the  corresponding  line  waits. 

CASE  A.  We  first  discuss  the  simplest  case  in  which,  in  addition  to  system  waits  of  each 
customer,  we  are  also  given  to  understand  that  none  of  the  corresponding  line  waits  is  zero. 
For  any  GI/G/1  queue,  if  W'1"’  and  H'J"’  are  the  system  and  line  waits  of  the  n  th  customer, 
respectively,  then 

(15)  W1"’  =  Wj"'  +  S1"' 

where  S1"1  is  the  service  time  of  the  n  th  customer.  Therefore 

(16)  W(n+"  -  W' " 1  =  W'"*"  -  MC"1  +  S(n  +  n  -  S("\ 

Since  no  W*"1  is  zero  by  assumption.  Equation  (16)  can  be  rewritten  using  Equation  (3)  as 


(17) 


fyS(ff  +  l)  _  - 1)  ^  o(/l)  _  J'(n)  ^(H  +  l)  _  g(/l  ) 

__  _  j'(ti) 


Since  T{n)  and  are  I1D,  the  distribution  of  [5('l+"  -  has  already  been  derived  and 

is  given  by  Equation  (5).  We  can  now  test  the  hypothesis  that  G  =  M  from  the  system  waits 
of  the  M/G/l  queue,  by  testing  whet  ter  the  first  differences  of  the  system  wails  have  come 
from  the  distribution  given  by  (5). 


CASE  B:  Suppose  instead  of  assuming  that  none  of  the  corresponding  line  waits  is  zero, 
we  are  told  that  some  of  them  are  indeed  zero.  That  is,  we  are  given  the  system  waits  of  an 
M/G/l  queue  with  the  additional  knowledge  as  to  which  of  the  corresponding  line  waits  are 
zero,  but  not  the  exact  values  of  other  corresponding  line  waits.  Equation  (16)  is  still  valid, 
and  by  substitution  for  [  W/l/(n  +  ”  —  H/,*"1]  in  Equation  (14),  we  have 

+  n  +  \)  fin)  jin)  £<//  +  !)  ^(w) 

=  5'"'  _  T*n-U  •+  |/Xf 


or 


+  _  y(«)  +  _  ^/(n+ll  _  |  K 

which  is  similar  to  Equation  (14).  Thus  we  can  find  the  values  of  [S("+n  -  7'("'|  using  Equa¬ 
tion  (19)  and  then  proceed  with  the  test  of  hypothesis  G  =  A/ as  before. 

CASE  C:  Suppose  now  that  we  are  given  the  system  waits  for  the  M/G/l  queue,  but  do 
not  known  anything  about  the  corresponding  line  waits.  The  solution  of  the  problem  is 
obtained  using  some  basic  concepts  of  probability  for  the  case  of  testing  when  a  parameter  X  or 
/u.  is  specified  and  using  a  Monte  Carlo  technique  if  neither  is  specified. 


For  the  first  subcase,  suppose  we  are  given  the  system  waits  of  each  customer,  Wn\ 
W2’ .  but  do  not  know  which  of  the  corresponding  JFj"’  are  zero,  that  is,  when  the 
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system  is  empty.  We  now  use  an  argument  similar  to  that  of  Case  l-B  again  by  noting  that  the 
limiting  expectation  of  W''1"'  is  l/(/u-A).  Thus  we  may  estimate  P„  *»  1  -  A/m,  and  assuming 
for  example  that  fi  is  given,  A  would  be  determined  as  indicated.  We  would  then  use  Equation 
(19)  as  before. 

Now  if,  instead,  there  is  no  knowledge  about  A  and  m  the  problem  becomes  more  com¬ 
plex. 


The  key  result  which  is  employed  in  arriving  at  a  reasonable  solution  to  the  problem  is  the 
conditional  distribution  of  7'<"-n  given  the  values  of  W/("\  If  we  define 

Vg,,«l  =  tytn  +  l)  _  =  £<»  +  !)  _  y-(«) 

then  the  conditional  density  of  T{")  given  |V  W[n)  =  d )  is 


f(l\d) 


/,(/)  /;(</  +  ?) 

g(d) 


From  Equation  (5)  this  density  can  be  found  as 


fU\d) 


\e~K'ne~,i(‘l+n  J  d  <  0, 
[AM/(A+M)]e‘/X  \'  >  ~d 

(d  >  o) 

[AM/(A+M)|e_,/" 


(A+M)  e-^)u+d)  \d  <0- 
>  -d 

(A+m)  (d>0) 


Thus  we  see  that  the  conditional  distribution  of  the  interarrival  times  is  either  exponential  or 
shifted  exponential  according  to  whether  d  >  0  or  d  <  0.  We  are  almost  in  a  position  to  con¬ 
struct  another  positive/negative  exponential  test.  We  say  almost  for  two  reasons:  (1)  the  values 
of  t  corresponding  to  negative  d  have  a  location  parameter  (this  is  no  problem  —  the  test  can 
be  adapted);  (2)  the  are  not  IID  (this  poses  a  problem  —  but  we  shall  assume  that 

the  resultant  t  values  do  form  a  (nearly)  random  sample).  We  need  to  do  some  Monte  Carlo 
testing  for  this  approach  but  our  earlier  experiences  suggest  success. 


ISSUES  FOR  FURTHER  WORK  AND 
CONCLUDING  REMARKS 

There  are  a  few  places  in  this  study  where  further  investigations  would  be  valuable  and 
could  tighten  up  the  procedures  somewhat.  As  examples  of  the  kinds  of  issues  which  might  be 
worth  pursuing,  we  suggest  the  following:  (1)  further  exploration  of  the  implications  of  our 
approach  to  the  Type  I  error  when  the  queue  traffic  is  indeed  quite  low;  (2)  to  derive  compara¬ 
tive  power  results  for  feasible  alternative  hypotheses  such  as  mixed  exponentials;  and  (3)  to 
study  the  nature  of  the  approximations  A,  and  A2  used  in  Part  I,  Case  B.  In  fact,  one  referee 
has  suggested  that  we  model  the  situation  in  a  decision-theoretic  set-up  to  arrive  at  a  decision 
rule,  that  minimizes  some  sort  of  risk  function  which  incorporates  any  sample  size  effects.  This 
is  an  interesting  possibility  for  some  new  research. 

An  interesting  additional  issue  is  raised  if  instead  of  having  an  M/G/l  queue,  we  have 
GI/M/1  and  are  given  line  waits  and/or  system  waits  and  are  asked  to  test  for  exponentiality  of 
the  interarrival  distribution;  the  entire  analysis  would  be  similar  and  we  can  carry  out  the  test  as 
before.  This  is  true  because  Equations  (2) -(9)  are  all  still  valid.  Furthermore,  by  virtue  of  the 
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continuity  of  basic  Gl/G/1  queue  properties  (for  example,  see  [13]),  the  size  of  the  test  is 
likely  to  be  approximately  equal  to  the  stated  significance  level  even  if  the  underlying  arrival 
process  is  non-Poisson.  However,  the  extension  to  more  complex  GI/G/1  systems  is  a  compli¬ 
cated  matter,  but  certainly  a  possibility  in  some  specific  queues  and  should  be  handled  on  a 
case-by-case  basis. 
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ABSTRACT 


The  problem  considered  is  10  assign  n  jobs  to  two  processors  so  as  lo 
minimize  Ihe  lolal  flow  lime,  with  the  conslraim  lhal  a  predetermined  partial 
ordering  (induced  by  batch  arrivals)  must  be  preserved  within  the  subset  of 
jobs  assigned  lo  each  processor  An  efficient  algorithm  of  time  0(»5>  is 
developed,  and  computational  experience  is  reported 


INTRODUCTION 

This  paper  considers  a  problem  of  assigning  n  jobs  to  two  parallel  processors  (machines). 
It  is  assumed  that  the  jobs  have  a  predetermined  partial  ordering,  reflecting  the  order  of  batch 
arrivals.  The  processing  times  of  the  different  jobs  by  the  two  (not  necessarily  identical)  pro¬ 
cessors  are  known,  and  each  job  has  to  be  processed  by  either  one  of  the  two  processors.  The 
objective  is  to  assign  the  jobs  to  processors  so  as  to  minimize  the  total  flow  time,  with  the  con¬ 
straint  that  the  original  partial  ordering  must  be  preserved  within  the  subset  of  jobs  assigned  to 
each  machine.  The  case  when  the  partial  ordering  is  complete  and  the  two  processors  are  ident¬ 
ical  was  solved  in  [7],  using  an  efficient  (polynomial^  bounded)  dynamic  programming 
approach.  An  extension  of  that  situation  to  the  case  where  processing  times  may  depend  on  the 
processor  as  well  as  on  the  job  were  recently  presented  in  [8,9] .  Turning  to  a  second  extreme 
case,  i.e.  when  the  ordering  is  empty,  we  observe  that  the  above  problem  can  be  solved 
efficiently  using  the  formulation  of  [1,5].  In  our  setting  the  empty  ordering  will  correspond  to  a 
joint  arrival  of  all  the  jobs,  while  the  complete  ordering  will  correspond  to  the  case  of  no  simul¬ 
taneous  arrivals. 

To  solve  our  model  we  combine  the  dynamic  programming  approach  of  [7]  with  the 
assignment  problem  formulation  of  [1,5]  to  yield  an  efficient  algorithm,  whose  time  complexity 
is  0(n5).  Computational  experience  is  provided  in  the  last  section. 

THE  MODEL 

Consider  a  service  center  consisting  of  a  waiting  facility  and  a  service  department.  The 
center  operates  as  follows,  customers  may  enter  the  waiting  facility  as  long  as  it  remains  open; 
a  period  during  which  the  service  department  is  closed.  Then  the  waiting  facility  is  closed  and 
additional  customers  are  rejected.  At  this  time  the  service  department  begins  to  serve  custo¬ 
mers  which  are  already  in  the  waiting  facility.  Each  customer  (job)  can  be  served  (processed) 
on  either  one  of  two  available  parallel  machines,  which  are  not  necessarily  identical.  However, 
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the  processing  of  a  job  cannot  be  interrupted,  once  it  has  been  started,  nor  can  it  be  divided 
between  the  two  processors.  One  cycle  of  operation  ends  after  all  the  customers  who  are  in  the 
waiting  facility  have  been  completely  serviced.  At  that  point  in  time  the  service  department 
closes,  the  waiting  facility  opens  and  new  customers  are  admitted. 

The  nature  of  the  system  allows  for  batch  arrivals  as  well  as  single  arrivals,  of  customers 
to  the  waiting  facility.  The  order  of  arrivals  induces  the  following  priority  constraints  on  the 
scheduling  of  the  jobs  on  the  two  machines.  If  two  jobs  have  not  arrived  in  the  same  batch  and 
both  are  assigned  to  be  processed  by  the  same  machine,  then  the  one  who  joined  the  waiting 
facility  earlier  is  to  be  processed  first.  (Note  that  this  constraint  does  not  apply  to  jobs  arriving 
in  the  same  batch). 


Define  the  flow  time  of  a  job  to  be  the  time  that  elapses  between  the  minute  the  service 
department  opens  and  the  completion  of  that  job.  Our  objective  is  to  assign  and  schedule  the 
jobs  in  a  way  that  minimizes  the  total  (or  average)  flow  over  all  jobs  in  the  present  cycle,  sub¬ 
ject  to  the  above  priority  constraint. 

Suppose  that  n  jobs  J\,  J 2 . J„  are  available  for  processing  when  the  waiting  facility 

closes.  We  say  that  job  J„  "precedes"  job  J,  ( J„>J ,)  if  and  only  if  J„  has  arrived  before  J,.  (If 
both  jobs  arrived  in  the  same  batch  then  neither  J„>J,  nor  J,>J„  and  we  write  JU~J,). 

Denoting  by  1 ,,,  /  =  1 ,  2,  y  =  l . n,  the  (deterministic)  processing  time  of  job  J,  by  processor  /, 

the  objective  is  to  minimize  the  total  flow  subject  to  the  constraint  that  if  J„  >  J,  and  both  jobs 
are  assigned  to  the  same  machine,  then  J„  should  be  processed  first. 


At  this  point  we  observe  that  for  the  model  considered  in  (7,8,9]  we  have  either  J,  >JU  or 
/„>/,  but  not  while  the  model  discussed  in  [1,5]  satisfies  y„=y,  for  all  pairs  of  jobs  J„ 

and  J,.  Equivalently,  in  our  setting  the  first  model  corresponds  to  the  case  of  no  batch  arrivals 
while  the  latter  corresponds  to  a  joint  arrival  of  all  the  jobs. 

Assuming  that  the  n  jobs  have  arrived  in  A-batches,  we  use  tn  to  denote  the  number  of 
jobs  in  the  p"'  batch  and  label  every  one  of  them  as  a  />-job.  (We  shall  also  say  that  the  job  is 

of  type  p).  Note  that  tp>\,  p  =  1,2 . A  and  rt  +t2  +...+  /*-  n.  We  also  assume  that 

batches  are  numbered  according  to  their  order  of  arrival.  Tn  is  defined  by 
Tn  =  tp  +  lr+ 1  +  ...+  /*. 

Since  our  objective  is  to  minimize  total  flow  (subject  to  a  certain  ordering)  it  is 

worthwhile  to  note  a  basic  property  of  that  criterion.  Suppose  that  jobs  y,(p . y,<r>  are 

assigned  to  machine  /  and  assume  further  that  Jnm)  precedes  y,(m+n,  for  m  =  1,  1. 

’  r 

Then  the  total  flow  of  these  jobs  is  £  (r-m+l)/,y(m).  Thus,  the  contribution  of  the  process- 

m  — l 

ing  time  of  job  Jj(m)  depends  only  on  the  number  of  jobs  it  precedes  but  not  on  their  process¬ 
ing  times.  For  future  reference  we  call  this  property  the  Basic  Flow  Property  (BFP) . 

Suppose  that  the  minimum  flow  is  achieved  when  mn  of  the  ir  "-jobs,  p= 1 . A  ,  are 

allocated  to  processor  1.  This  is  illustrated  in  the  next  figure. 


Processor  1 


Processor  2 


mr 

t\-m] 

lP-mp 

h~f»k 

L 


SCHEDULING  JOBS  TO  TWO  MACHINES 


523 


Given,  p.  1  <_  p  <_  k,  the  BFP  then  implies  that  the  contribution  of  processing  times  of 
all  jobs  of  types  greater  than  or  equal  to  p  can  be  obtained  by  ignoring  jobs  of  type  less  than  p. 
Hence,  suppose  that  only  ./-jobs,  p  <_j  <_  /care  available  for  processing  and  denote  by 

0, 1 . Tp  the  minimum  flow  of  all  jobs  of  type  greater  than  or  equal  to  p,  provided  m  of 

them  are  processed  by  machine  1. 

To  find  gp(\,m)  assume  the  number  of  type  p  jobs  assigned  to  machine  1  is  mp 
0 <_mp<_m.  (Note  that  mp  has  also  to  satisfy  mp<tp  and  m-mp<Tp+\ ).  Let  fp(\,mp,m)  denote 
the  total  contribution  of  the  processing  times  of  p-jobs  to  the  total  flow  gp(\,m),  when  mn  p- 
jobs  are  assigned  to  machine  1 .  By  the  BFP  it  follows  that 

gp(l.m)  *  minimum  [fp(\,mp,m)  +  gpU(l,m-mp)) 
v  1 '  '"P 

P= 1 . *-1,  where  mp  varies  between  max(0,w-7'/)+|)  and  min (m,tp)  . 

To  solve  our  original  sequencing  problem  we  use  the  recursive  relation  (1)  to  compute 
#i(l.w)  for  all  integers  m  such  that  0 < m  <  T,  =  n.  The  optimal  solution  is  the  minimum  of 
[g\{\,m)\m  =  0, 1, - n). 

To  app’ly  the  recursive  relation  (1)  we  next  show  how  to  compute  fp(l,mp,m), 
P  —  1 . *  — 1,  and  gk(  \  ,m-nip)  by  using  a  linear  assignment  problem  formulation.  Our  for¬ 

mulation  is  a  modification  of  that  in  (1,5]. 

Let  J,  be  an  arbitrary  p -job.  If  Jr  is  assigned  to  machine  /  and  it  precedes  (u-1)  p-jobs 
and  v>  jobs  of  higher  types  on  machine  /,  then  the  contribution  of  its  processing  time,  ,  to  the 
total  flow  of  all  the  jobs  is  (u  +  v)t„.  Jr  is  then  said  to  have  occupied  the  wth  position  at 
machine  i.  This  position  is  denoted  by  (/,«).  To  find  fp(l,mp,m)  we  consider  only  those 
schedules  that  assign  exactly  mp  p  -jobs  and  m-mp  jobs  of  higher  types  to  machine  1.  Define  a 
linear  assignment  problem  by  the  following  bipartite  graph.  The  first  set  of  nodes  consisting  of 
tp  nodes,  corresponds  to  the  tp  p  -jobs.  A  typical  node  is  denoted  by  ( Jr )  where  Jr  is  a  p  -job. 
The  other  set  of  nodes  is  the  set  of  tp  positions  assigned  to  the  p-jobs,  i.e.,  mp  positions  on 
machine  1  and  tp-mp  positions  on  machine  2.  These  nodes  are  labelled  as  (/,«)  nodes,  /-1,2. 
In  the  corresponding  bipartite  graph  each  ( Jr )  node  is  connected  to  each  (/,«)  node.  Further¬ 
more  if  (Jr)  is  assigned  (l,u),  u  =  1,  . . .  ,mp,  then  the  ‘cost’  associated  is  ( u+m-mp )  tu  since 
m-mp  jobs  of  type  higher  than  p  are  also  assigned  to  machine  1.  Similarly  an  assignment  of 
( Jr )  to  (2 ,w),  u  —  1 . . .  ,ip— mp,  yields  a  cost  of  (u  +  Tp+\—(m—mp))tir  where 
7/>  +  l  t/7  +  l  "F  t/>+2"F  •  •  •  “Ftfr* 

Following  arguments  similar  to  those  in  [1,5]  we  easily  verify  that  the  minimum  solution 
of  the  above  linear  assignment  problem  is  indeed  equal  to  fp(l,mp,m).  (We  call  the  above 
assignment  the  (p.m,w„)  assignment).  We  also  realize  that  an  almost  identical  scheme  com¬ 
putes  gk(\.m)  for  w=0, 1 . /*.  If  J,  is  a  fc-job  which  is  assigned  to  position  (l,w), 

w  =  1 . w,  (or  (2,n),  «  =  1 . U~w),  then  it  is  followed  on  machine  1  (machine  2),  by 

exactly  (h-1)  jobs  of  its  type  and  no  jobs  of  other  types.  Thus  we  may  suggest  the  above 

assignment  formulation  for  the  solution  of  gk(\,m),  m  =  0,1 . ik.  The  ‘cost’  associated 

with  the  arc  connecting  ( J ,)  and  (/,w),  /  =  1,2,  is  ut,r. 

We  summarize  our  solution  approach  with  the  following  scheme. 

STEP  1  For  each  m  =  0 . ik  compute  gk{\,m).  Set  p  =  dr-1,  and  m  -  0. 

For  any  integer  mp  satisfying  mdix(Q,m-Tp+])<^mp<m\n(m,tp)  compute 
J'p(\,mp,m ),  the  minimum  of  the  ( p,m,mp )  assignment. 


STEP  2 
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STEP  3  Define 

gP(\.m)  =  minimum  +  gp  +  \(\ 

"V 

If  m  =  Tp  go  to  Step  4,  otherwise  increase  m  by  1  and  go  to  Step  2. 

STEP  4  Decrease  p  by  1.  If  p  =  0  go  to  Step  5.  Otherwise,  set  m  =  0  and  go 

to  Step  2. 

STEP  5  Find  the  minimum  of  (#,(1,0) . £,(!,«)}. 


Several  comments  are  in  order.  When  one  considers  the  case  of  [7,8,9]  i.e.  no  batch 
arrivals,  then  the  corresponding  ( p,m,mp )  assignments  are  trivial  since  w/ takes  on  the  values 
0,1  only. 

Let  Jp  denote  the  only  p  -job.  Then  it  is  easily  verified  that  #A(l,l)  =  ru.  and 
g*(l,0)  =  t2k.  (Note  that  k  =  n).  Similarly,  we  obtain  fp(l,l,m)  =  mtXp  and 

fp(l,0,m)  =  (Tp— m)t2p  =  (n+\—p—m)t2p  for  m  =  1, 2 . n—  p.  If  m  =  0  then  we  have 

/pU.O.O)  =  Tp-t2p  =*  (n+\—p)t2p  while  the  case  m  =  Tp  =  (n—p  + 1)  yields 

fp(l,\,n+\-p)  =  (n+\-p)t{p. 

Thus,  for  p  =  1,  . . .  ,/r-l  the  recursive  relation  (1)  is  replaced  by 

(2)  gpO.w)  -  minimum  [mtXp  +  ,m-l);(n+l-p-  m)t2p  +  g^+l(l,m)}  , 

when  m  “  1, 2,  . . . ,n—  p,  by  gp(l,m)  =-  (n+l—p—m) i2p  +  gp+l(\ ,m)  when  m  =  0,  and  by 
gp(\,m)  =  mtXp  +  gp+\ ( 1  1 )  when  m  =  n-p  +  l. 

Turning  to  the  other  extreme  case,  i.e.,  all  jobs  arrive  at  the  same  time,  then  A  =1  and  it 
suffices  to  solve  (n  +  1)  assignment  problems  (each  with  2 n  nodes)  to  obtain  minimum 
(g.d.O),  gi(l,l),  . ..  ,g|(l ,//)}.  In  fact  a  single  assignment  with  3  n  nodes  can  replace  the 
above  (w  +  1)  problems  to  yield  the  optimal  solution.  (See  [1,5]). 

Finally  we  point  out  that  if  processing  times  depend  only  on  the  job  but  not  on  the  pro¬ 
cessor,  i.e.  the  identical  machine  case,  then  batch  arrivals  can  be  reduced  to  the  situation  of  sin¬ 
gle  arrivals.  This  is  done  by  ordering  jobs  of  the  same  batch  according  to  increasing  processing 
times  and  then  applying  the  dynamic  programming  algorithm  of  [7]. 

COMPUTATIONAL  EFFORT 

To  find  the  total  number  of  calculations  required  to  solve  the  optimal  policy  by  our 
method,  we  first  focus  on  the  ( p.m,mp )  assignments. 

Computing  gk(\,m),  m  =0,1 . tk ,  involves  the  solution  of  (r*  +  l)  assignment  prob¬ 

lems,  where  each  is  associated  with  a  bipartite  graph  of  2 tk  nodes.  In  the  next  step 

/*_i(l,wA_|,m)  is  computed  for  all  m  =0,1 . 7V_,  and  max(0,m-Tk)<,mk_,<min(m.ik.]). 

In  general,  to  find  gp(\,m),p  =  \ . Ar  — 1;  m  =  0, 1 . Tp ,  from  gp^(\.m), 

m  “0,1 . Tp+ 1,  our  scheme  requires  the  computation  of  fr(l,mp,m)  for  all  m  =  0,1 . 

Tp  and  max(0,/n  —  Tp+X)  <_mn <min (m,tp).  Partitioning  the  feasible  domain  of  the  indices 
( m,,,m )  shows  that  the  number  of  ( p,m,mr )  assignment  problems  -  each  with  2 tr  nodes  -  solved 
by  the  scheme  is 
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Ap  =  (Sp  -  s„)(s„+l)  +  (s„+l)(s„+2)/2  +  (Tp-Sp)(Tp-Sp+\)/2 
where  Sp  -  ma\(ip.Tp^)  and  sp  «  min(//,,7'/,,l). 

Following  0.4,6]  we  noie  that  a  solution  of  an  assignment  problem  with  2 ip  nodes 
requires  00, ,3)  elementary  operations.  Hence  the  total  computational  effort  spent  on  solving  the 
( p.m.m ,,)  assignments  is 

0l(l+7*)f*3+X  'V0J1  “  OOrOi— A+l)3) 

r- 1 


From  (1)  it  follows  that  in  addition  to  the  above  computational  effort  we  have  to  perform 
certain  comparisons  and  additions.  A  simple  analysis  shows  that  the  latter  effort  is  bounded  by 
OOr).  Hence  the  total  number  of  calculations  spent  to  solve  the  original  sequencing  problem  is 
dominated  by  OOrOi-A  +  l)’),  where  //  is  the  number  of  jobs  and  A_<«  is  the  number  of  bulks. 

The  above  algorithm  has  been  programmed  and  tested  on  several  problems.  Using  the 
CDC-6500  computer  installation  at  Tel  Aviv  University  we  have  run  problems  with  randomly 
generated  data  of  up  to  300  jobs  clustered  into  up  to  20  batches.  Early  results  yield  execution 
times  of  3  to  5  seconds  for  the  300-job  problems.  Since  we  have  used  an  ordinary  algorithm  to 
solve  the  assignment  problems,  we  feel  that  run  times  can  be  further  decreased  by  implement¬ 
ing  the  algorithm  reported  in  [2,  Section  3.9],  which  is  specially  designed  to  solve  the  assign¬ 
ment  problems  arising  in  our  model. 
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ABSTRACT 

We  consider  ihe  problem  of  scheduling  n  tasks  on  two  identical  parallel 
processors.  We  show  both  in  the  case  when  the  processing  times  for  the  W 
tasks  arc  independent  exponential  random  variables,  and  when  they  arc  in¬ 
dependent  hyperexponentials  which  are  mixtures  of  two  fixed  exponentials, 
that  the  policy  of  performing  tasks  with  longest  expected  processing  time 
(LKPTI  first  minimizes  the  expected  makespan.  and  that  in  the  hyperexponen- 
lial  case  the  policy  of  performing  tasks  with  shortest  expected  processing  lime 
(ShPT)  first  minimizes  the  expected  flow  lime.  The  approach  is  simpler  than 
the  dynamic  programming  approach  recently  employed  by  Bruno  and  Downey. 


I.  INTRODUCTION 

Suppose  that  two  identical  parallel  processors  are  available  to  perform  tasks  1 . n  with 

random  processing  times  X\,  .  .  .  ,  X„.  Performing  task  j  requires  one  of  the  processors  (either 
of  the  two  can  do)  for  a  duration  Xh  after  which  it  is  complete.  Tasks  are  performed  consecu¬ 
tively,  starting  at  time  t  =  0,  so  that  as  soon  as  a  task  is  complete  another  task  is  put  on  the 
processor  that  is  freed.  For  any  permutation  ,/j . j„  of  1 . «,  putting  tasks  on  the  pro¬ 

cessors  in  that  order  defines  a  schedule.  It  is  assumed  for  every  task  j  that  X ,  is  independent  of 
all  other  X's,  of  the  schedule,  of  the  moment  its  processing  starts  and  of  the  processor  on 
which  it  is  performed. 

Two  criteria  are  commonly  used  to  judge  the  performance  of  a  schedule:  Flow  time  —  the 
sum  over  all  tasks  of  the  time  from  zero  to  completion,  and  makespan  —  the  time  from  zero 
until  all  tasks  are  completed.  These  give  rise  to  two  problems: 

PROBLEM  /: 

Find  a  schedule  that  minimizes  the  expected  flow  time. 


•This  work  was  done  while  the  authors  were  at  the  University  of  California.  Berkeley,  at  the  Department  of  Industrial 
Kngineering  and  Operations  Research  and  the  Department  of  Statistics. 
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PROBLEM  2: 

Find  a  schedule  that  minimizes  the  expected  makespan. 

Two  special  schedules  based  on  the  expectations  of  A, . A1,,  are  intuitively  appealing: 

SEPT  -  (shortest  expected  processing  time  first)  which  uses  the  order  y, . j„  where 

£(T(i)  <  £(A(J)  <  ...  £(A,  );  and 

LEPT  -  (longest  expected  processing  time  first)  which  uses  the  order  ./„ . j\. 

In  the  case  where  A| . A",,  are  deterministic  (i.e.,  given  real  numbers),  it  is  known 

that  SEPT  is  the  solution  to  Problem  1  [2].  However,  LEPT  does  not  in  general  minimize  the 
makespan,  and  it  was  shown  by  Karp  [3]  that  finding  a  schedule  to  solve  Problem  2  is  an  NP- 
complete  problem.  By  that  one  means  that  it  belongs  to  a  large  collection  of  problems  which 
have  the  same  degree  of  computational  complexity,  and  for  which  it  is  conjectured  that  no  poly¬ 
nomial  time  algorithm  exists  to  solve  them.  In  the  makespan  problem  this  conjecture  means 
that  virtually  all  2"  possible  schedules  need  to  be  enumerated. 

In  the  case  where  A| . AC,,  are  exponentially  distributed,  Bruno  and  Downey  [1]  have 

recently  shown,  using  dynamic  programming,  that  the  SEPT  and  LEPT  schedules  do  indeed 
solve  Problems  I  and  2  respectively.  We  present  here  another  proof  that  LEPT  solves  Problem 
2. 


We  also  consider  an  additional  case,  where  each  of  A, . A„  is  distributed  as  a  mixture 

of  two  fixed  exponential  random  variables.  In  the  context  of  application,  this  corresponds  to 
the  case  where  the  work  required  by  each  task  is  either  long,  exponential  with  parameter  <x,  or 
short,  exponential  with  parameter  n2  ( Mi  <  M2).  and  we  know  for  each  task  the  probability  H 
that  it  is  long.  In  this  special  hyperexponential  case  we  show  'hat  SEPT  and  LEPT  solve  prob¬ 
lems  1  and  2  respectively.  The  approach  is  simpler  than  the  dynamic  programming  approach  of 
Bruno  and  Downey. 

2.  PRELIMINARIES 

To  the  tasks  1,  ....  n ,  with  associated  durations  AIt  ....  Xn  we  add  task  0,  with  dura¬ 
tion  A0.  We  assume  that  X0,  Xx,  ,  Xn  are  independent  nonnegative  random  variables.  For 
a  permutation  of  1  let  Tj,  .  ,  Y„  -  XJt,  ...  ,  A^.  We  call 

A0,  Yt . Y„  a  schedule.  The  performance  of  the  schedule  proceeds  from  t  =  0  as  follows: 

at  time  t  —  0  the  previously  scheduled  task  0  is  on  one  of  the  processors,  and  occupies  it  until 
A0,  when  it  is  complete.  Task  j\  is  put  on  the  other  processor  at  t  -  0,  which  it  occupies  until 
time  Y\,  when  it  is  complete.  At  the  first  completion,  task  j2  is  put  on  the  freed  processor,  and 
tasks  continue  to  be  put  on  processors  when  they  become  available.  We  denote  by: 

(1)  0  <  r„(A„,F, .  Y„)  <  r,(A0.i,l .  f„)  <  ...  <  r„(A 0,y, .  y„) 

the  completion  times  of  the  tasks  in  their  order  of  occurrence.  Task  jk .  2  is  put  on  a  processor 

at  7j(An,  Y 1 .  Y„),  k  =0,1 . n  -2,  and  occupies  it  until  its  completion  at 

Tk(X0,Y\ .  Y„)  +  Yk+2.  The  two  processors  complete  their  tasks  at  r„_|(A0.  )j .  Y„) 

and  EJXn.Y, .  Y„).  We  define 


(2) 


D(Xa.Yx .  YJ  =  7"„(  A0.  Y 1 .  Yn)~  T„.x(X0,Yx .  Y„). 
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The  makespan  of  the  schedule  is  K, .  Y„).  Let 

■S  =  -To  +  +  •  •  •  +  X„. 


We  note  that: 


(3)  S  =  7-(l_1(Jr0.K, .  Y„)  +  TJXo.Yi .  Y„) 

=  2T„(X0.Yi .  Y„)-D(X0.Y, .  Y„) 

=  2r„_,(A'o,Tl .  Y„)  +  D(X0,Y .  Y„) 

and,  since  S  is  independent  of  the  order  in  which  tasks  are  performed,  a  schedule  which  minim¬ 
izes  the  expected  value  of  D  will  at  the  same  time  minimize  the  expected  makespan.  We  shall 
prove  the  optimality  of  LEPT  for  Problem  2  by  showing  that  it  minimizes  D  stochastically. 


The  flow  time  of  the  schedule  is  the  sum  of  all  the  completion  times,  £  Tk 

k-  o 

n  -  2 

(-T0.  Y .  K„).  This  differs  from  the  sum  of  all  the  starting  times  £  Tk(XQ.Y\ .  Y„) 

k-0 

by  S,  so  that  the  expectations  of  these  two  sums  are  minimized  simultaneously.  We  shall  show 
in  the  hyperexponential  case  that  SEPT  minimizes  the  expectation  of  each  of 
r,(X0.Y, .  YJ,  k  =  0, 1 . ,1-2. 

If  we  look  at  the  performance  of  tasks  0J, . jk  1  <  k  ^  n  alone,  and  use  definitions 

(1),  (2)  for  k  instead  of  n ,  we  note  that: 


(4)  T,(Xn.  K, .  Y„)=TAX0,Yi .  Yk)  /-  0,1 . k  -  1 

while 

(5)  W, .  T„)  =  r*_,(A'0,  T, .  Yk)  +  min  (Yk+l,  D(X0,Y\ .  Yk)). 


We  remark  that  the  addition  of  task  0  generalizes  the  original  problems  which  correspond 
to  XQ  =  0.  It  disposes  of  the  need  to  schedule  two  tasks  simultaneously  at  t  =  0,  and  thus 
makes  the  SEPT  and  LEPT  schedules  unique. 

Notation. 

A  2  B  denotes  that  A  is  stochastically  greater  than  B.  that  is:  P(A  >  x)  >  P(B  >  x) 
for  all  x. 

3.  THE  EXPONENTIAL  CASE: 

We  now  assume  that  Xt . X„  are  exponentially  distributed  with  rates  . fi„. 

The  next  lemma  examines  the  effect  on  D  of  changing  a  schedule  by  interchanging  two  con¬ 
secutive  tasks. 

LEMMA  I: 

For  any  X„  and  for  =  min(M|.M2 . 

(6)  D(Xn.X,.X: . *„)  £  . . . 


Wi  y- Vi •  i  r‘  rr  " 
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PROOF. 

Denote  by  pj  (</,),  y  —  0,1,  ....  n  the  probability  that  the  last  task  to  be  completed  by 
the  schedule  X0,X\.  •  •  ■  .  X„  (Xq,Xi,X\,  ....  X„)  is  task  j.  We  show  by  induction  that 

(7)  Mo  =  do 

P\  ^  d\ 

P,  >  d,  ./  =  2 . n. 

This  will  imply  (6)  since  the  distribution  of  D(X o.Xt.X2 . X„)  (of  D(X 0,X2,Xf, 

//  n 

. . .  .X,,))  is  a  mixture  of  the  distributions  of  Xa  -  £  X,  |  Xn  >  £  X ,,  Xt,  ,  X„  with  mix- 

!-\  /-I 

ing  probabilities  />0.Mi . p„  (<y0,<7i,  ••  .  </„)  and  if  (7)  holds,  the  distribution  of 

D(X  o.A'i.A'i . X„)  can  also  be  regarded  as  a  mixture  of  the  distributions  of 

n  n 

*o  -  I  I  >  £  Xn  Xx.Z2 . Z„  with  probabilities  p0,px . p,n  where  Z,  is  a  mix- 

/-i  /-I 

ture  of  A" |  and  X,  with  probabilities  (p,  -  d,)/p,.  d,/Pn  and  since  X,  C  Xx,  X,  C  Z, 
j  =  2 . n. 


To  check  (7)  for  ii  =  2,  condition  on  A'o  =  .v,  to  obtain: 

Po  -  do  -  P(Xx  +  X2  <  x) 


P\  =  e 


-M|'  ^2 

Ml  +  M2 


d\  =  1  ~  do  ~  d 2 


Pi  =  1  ~  PO  ~  P\  d 2  =  e 


~fJL2y 


Ml  +  M2 


(9)  ^  =  [e~X' -  e~»'] 

Pi  -  Ml 

and  get  (7)  by  unconditioning. 

For  n  >  2,  denote  by  pj  (qj)  j  —  0, 1 . n  —  1  the  corresponding  probabilities  for 

X0.X\,  ...  .  2f„_i  (A’0,Ar2,A'1,  ...  ,  Ar„_|) ,  and  assume  (induction  hypothesis)  that: 

(10)  Po  “  tfo 

Mi  <  <7i 

M,’  >  d'j  y-2 . n  -  1. 

Then: 

(11)  Mo  “  do  ”  ^(^i  +  Z2  +  . . .  +  X„  <  X0) 


,  Mn  ,  Mn 

Pj“Pjpj+pin’  flj  +  Mn 

j  -  1 . «  -  1. 


■nHBBBBBHVMBnBBII 
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So  from  (10) 
(13) 


P i  <  <7i 


Pj  >  Q,  j  “  2,  ...  ,  n  -  1. 


Pn  >  Pn 


P\+  Pn  Pj  +  P„ 


Also,  by  /Lt I  <  Hj  for  all  y  =  2,  ....  »  -  1, 

(14) 

which  with  (10)  implies 

(15) 
and  so: 


y  -  2 . /*  —  1 


«-l  ft, 

J  Pj  Pj  +  P„  '  "'Pj+Pa 


n- 1 

*  Z  q'j- 


(16) 

We  can  now  prove 


Pn  >  <7„. 


THEOREM ;  /: 


For  arbitrary  and  for  . X>>  independent  exponential  random  variables  the 

LEFT  schedule  minimizes  the  expected  makespan. 


PROOF. 


We  assume  mi  <  P2  <  •••  <  M,„  so  £(T,)  .  .  .  >  £(T„)  and  the  LEPT  schedule  is 

*o.A| . X„.  By  (3)  it  is  enough  to  show  that  for  any  schedule  A'0,  F, .  Y„ 


(17)  E(D( X0,Xt . X,,))  <  EiD(X0.Y .  Y„)). 

We  prove  the  stronger  assertion,  that 

D(X0,Xl . X„)  C  D(X«.Y\ .  Y„). 


(18) 


For  n  -  2,  (18)  holds  by  Lemma  1.  Assume  inductively  that  it  holds  for  n  -  1  where 

"  >  2-  Look  at  an  arbitrary  schedule,  X0,Y2 .  Yk.Xx,Yk+ , . Y„,  where  k  >’l.  We 

can  regard  D(X0,Y2 .  Yk,XuYk+, . Yn)  as  D(Z,Yk.XuYk+l . Yn)  where 

z  -  D{X0,Y2.  ...  ,  >*_,).  By  Lemma  1  this  is  stochastically  larger  than  D(Z,Xx,Yk . Y„) 

which  is  the  same  as  D(X0,Y2,  ...  ,  Yk-\,X\,Yk . Yn).  Apply  this  argument  k  times  to 

get: 


(19) 


D ( X(),X \ ,  Y2 .  Y„)  C  D(X0.Y2 .  Yk.XuYkU .  Y„). 


Now  regard  D(X0.XUY2 .  Y„)  as  D(Z'.Y2 .  Y„)  where  Z  -  D(X0.X,),  and 

apply  the  induction  hypothesis  to  obtain  (18). 


4.  THE  HYPEREXPONENTIAL  CASE 

We  now  assume  that  the  distribution  of  X,  is  £,,  y  «  1 . „  where 

(20)  F,ix)  =  P(X,  >  x )  -  +  (1  -  e,)  e^2'. 


• — <MI  mmi  Mi 


i 
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and  mi  <  M2-  Obviously  *  3  X,  if  ft,  ^  ft,.  The  next  lemma  again  examines  the  effect  on  D 
of  interchanging  two  consecutive  tasks. 

LEMMA  2: 

For  arbitrary  A'o,  if  ftk  >  t tk  +  ]  for  some  1  <  A  <  «,  then: 

(21)  FX^n.A', . Xk.Xk+i . X„)  C  DfXlhXl . Xk^.Xk . X„) . 

PROOF: 


We  consider  first  A  =  1,  so  0,  >  02.  We  note  that  ZMJTo.Jr, . X„)  is  either  the 

remainder  of  task  0,  X0  -  jr  X,  |  A'o  >  £  X ,,  or  else  it  is  an  exponential  random  variable 

,-i  ,-t 

either  with  rate  Mi  or  with  rate  M2-  We  denote  the  probabilities  of  these  three  possibilities  by 
Po  “  P  X0>  5-  x,  ,  p,  1  -  p0  -  p  respectively.  We  denote  by  q0,  q\  p <J,  p'\  q'Q,  q  the  proba¬ 
bilities  of  the  same  events  for  the  schedules  Afo.ATj.A', . X„\  A'o.A', . X„.x\ 

X0,X2,Xh  ....  Af„_,.  Obviously  p0  -  <?0>  Po  =  and  to  show  that  D(X  0,Xi,X2,  ...  A1) 

£  DlX0.X2.Xi . *„)  we  have  to  prove  that  p  <  q. 

For  n  =  2,  condition  on  T0  *  x  to  obtain, 

(22)  P  =  Mite"*1*  +  ti,xe^,x)  +  0,(1  -  02)e~M|X  —  2-  + 


(1  -  0,)02  e 


Mi  +  M2  M2  _  M 


Ml  +  M2 

(|.'M'V-  e~M‘") 


and  a  similar  expression  for  q.  By  subtracting: 

(23)  q  -  P  =  (0,  -  «,) 

M2  ~  Ml 

which  upon  unconditioning  shows  that  q  >  p. 


-  e~^')  £0. 


Let  now  n  >  2,  and  assume  inductively  that  q'  ^  p‘.  Then: 

(24)  P  “  p’0*  +  p'(l  -  0„)  — ^ —  +  (1  -  Po  -  p')  »„ — — —  + 

M|+M2  M1+M2 

pt>enP(Xx  +  X2  +  ...  +  X„  >  Xo  |  X,  +-...  +  -  exp  (Mi>) 

where  the  last  term  on  the  RHS  is  independednt  of  the  schedule  of  A"| . A  similar 

expression  holds  for  q,  and: 

(25)  q  ~  V  —  (q'  ~  [>')  ft,, — ~ —  +  (l-0„) — — —  >0. 

Ml  +  M2  Mi  +  M2 

For  any  A  >  1,  apply  the  lemma  as  proved  for  A  =  1  to  obtain  that  D(Z. Xk.Xk^,  ....  A„) 
C  D(Z,Xk+l,Xk . X„)  which  yields  (21)  when  Z  =  D(Xa,X\ . A'a_,).B 


We  can  now  prove: 
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THEOREM  2: 

Let  Xn  be  arbitrary,  . X„  be  hyperexponential  random  variables  as  in  (20),  with 

Wi  ^  02  . . .  ^  f)„,  then. 

(i)  The  LEPT  schedule  A'0,A'| . X„  minimizes  the  expected  makespan 

(ii)  The  SEPT  schedule  XQ,X„,  ...  ,  X,  minimizes  the  expected  flow  time. 

PROOF. 

(i)  Any  schedule  -V0,  ) 1,  ....  can  be  changed  by  a  sequence  of  steps,  each  involving 
an  interchange  between  a  longer  task  and  a  shorter  task  that  directly  precedes  it,  to 

the  schedule  X0.\ , . X„.  At  each  step  the  resulting  random  variable  D decreases 

stochastically  by  Lemma  2.  Part  (i)  follows  by  (3). 

(ii)  Let  X,i.  K, .  Y„  be  any  schedule,  and  assume  Yk  2  Kt  +  I.  We  compare  this 

schedule  with  X0.Yt .  Yk+iJ’k . Y„.  We  note  by  (4)  that: 

(26)  T,(X0.Yt .  YJ  =  T,(X0.Y, .  F„_,) 

-  l(X0.Y, .  Ykkl.Yk .  YJ 

i  -0,1,  ....  k  -  2 


and  by  (5)  that  for  k  -  1: 

n~i(x0.rt .  .  YJ  = 

r*_2W0.K| .  K;_,)  +  min  (  Yk,D(X0,  K, .  FA_,))  2 


(27)  r*_2U0.)'i .  T*_|)  +  min  ( Yk+l,D(.X0,  .  FA_,))  - 

7*-i(-^o.L| .  .  YJ. 

Finally  we  want  to  compare  T,(X0.Y .  FA,FA+1 .  YJ  with  T,(X0J\ .  Yk^.Yk, 

...  .  F„)  for  /  =  k,k  +  1, . n  —  1.  From  Lemma  2 


(28)  D(Xn.Y{ .  Yk,Yk+i .  K,.|)  £  D(X0.Y .  Yk^.Yk. 

and  this  implies  by  (3) 


Y,  + 1 


) 


(29)  E(TJX0,Y{ . 

E(T\ X0,  Y . 

which  by  (4)  is  the  same  as: 


n.n+ . . r,+.»  ^ 

Yk+uYk .  Y,  +  ])) 


E(TJX„. 


E(TJX0.Yi .  KA,FA  +  I . YJ) 

Yi .  Yk  +  h  Yk .  Y,,))  i  =  A, 


n  -  ! 


(30) 
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Using  (26),  (27),  (30)  we  have  shown: 

E  £  r,U0.K| .  n,n  +  1 .  Y 

/-0 

I  l(X0,Y . .  K*+I.K* .  L„)J 

Thai  is,  if  Yk  2  Yk+ 1,  their  interchange  will  decrease  the  expected  flow  time.  The  proof  is 
completed  by  an  argument  similar  to  Part  (i).| 

REMARKS. 

The  following  remarks  should  be  made  with  respect  to  our  results. 

(i)  The  policies  that  were  shown  to  be  optimal  in  Sections  3  and  4  are  not  only  optimal 
in  the  class  of  n\  possible  sequences  which  determine  in  advance  (at  time  zero) 
which  task  will  be  next  whenever  one  has  been  completed  (independent  of  past  his¬ 
tory  of  the  process),  they  are  also  optimal  in  that  class  of  policies  which  allows  the 
decision  maker  to  review  his  policy  at  every  task  completion,  taking  into  considera¬ 
tion  what  occurred  before.  To  see  why  that  is  true  assume  that  at  the  n  -  k  decision 
moment,  when  only  k  tasks  are  still  to  be  scheduled,  a  schedule  can  be  determined  in 
advance  for  all  the  remaining  decision  moments.  This  is  obviously  true  for  k  =*  I. 
Theorems  1,  2  applied  to  the  task  currently  processed  as  task  0,  and  the  as  yet 

unscheduled  tasks  as  tasks  1 . k  -  1  then  show  that  the  schedule  must  be  LEPT 

for  Problem  1  and  SEPT  for  Problem  2.  Hence  at  the  n  —  k  —  1  decision  moment, 
the  decision  maker  will  chi  ose  the  task  to  be  scheduled  immediately,  and  will  also 
determine  in  advance  the  schedule  of  the  k  tasks  not  scheduled  immediately. 

We  also  note  that  in  both  cases  discussed  in  Sections  3  and  4,  when  .V(l  =  0.  and 
LEPT  is  used,  at  any  of  the  above  decision  moments  the  task  already  on  the  proces¬ 
sor  has  the  longest  expected  remaining  processing  time  among  all  uncompleted  tasks. 
This  is  trivially  true  for  the  exponential  case,  and  is  true  for  the  hyperexponential 
case  because  the  X,'s  have  DFR  distributions.  Hence  a  similar  argument  to  the 
above  shows  that  LEPT  determined  in  advance  is  optimal  among  all  the  policies 
which  allow  rescheduling  and  preemption  at  decision  moments. 

(ii)  The  LEPT  policy  is  also  optimal  when  . X„  are  mixtures  of  exponentials  with 

the  rate  of  X,  a  random  variable  A,,  and  P{.\ ,  <  A2  <  ...  <  \„)  =  1.  However,  if 
we  only  require  A|  C  A2  C  ...  C  A„,  LEPT  is  not  in  general  optimal  as  the  follow¬ 
ing  counterexample  shows. 

A,  —  exp  (1) 

X2  ~  exp  ( A | ) .  m,  =  I)  =  /»( A,  =  4)  =  y 
*3  ~  exp  (A2),  P(A2  -  1)  -  P(A2  =  5)  =  y. 

Obviously  X\  D  X2  D  X}.  However  the  expected  makespan  of  the  schedule  X\.  X2.  X\ 
is  8421/5400  while  that  of  Xh  X2  is  8420/5400. 
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(iii)  We  were  unable  to  show  that  SEPT  minimizes  expected  flow  time  in  the  exponential 
case  because  Lemma  I  only  holds  for  pairwise  switches  involving  the  longest 
remaining  task. 
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ABSTRACT 

We  consider  sequencing  of  «jobs  which  will  arrive  intermiltently  and  are  to 
be  processed  on  a  single  machine;  the  arrival  and  (he  processing  limes  of  each 
jobs  are  assumed  known  A  schedule  is  to  be  developed  that  minimizes  the 
mean  How  time  Two  models  are  considered:  (i)  when  no  pre-emption  or  in¬ 
serted  idle  lime  is  allowed  in  the  schedule,  and  (ii)  when  pre-emption  is  al¬ 
lowed  but  the  jobs  follow  a  pre-empt-repeat  discipline  We  illustrate  thai 
Cobham's  and  Phipp’s  SPT  dispatching  rule  does  not  guarantee  the  optimum  F 
even  for  the  non-preemptive  model  We  propose  a  branch  and  bound  algo¬ 
rithm  for  both  models  and  discuss  our  computational  experience.  We  also  ex¬ 
amine  the  relative  performances  of  ihe  optimum  nonpre-emptive  sequence,  and 
the  optimum  pre-empt-repeat  sequence  over  that  resulting  from  SPT  dispatch¬ 
ing  rule  on  a  large  number  of  sets  of  jobs  of  varying  sizes  and  tightness. 


1.  INTRODUCTION 

We  consider  the  following  two  models  of  the  basic  single  machine  dynamic  deterministic 
problem: 

Model  A:  a  nonpre-emptive  n/l/F, 

Model  B:  pre-empt-repeat  n/l/F. 

Model  A  may  be  characterized  by  the  following  six  conditions: 

1.  There  are  n  jobs  to  be  processed.  Job  j  (j  =  1,  2 . n)  arrives  at  time  /•,  and 

requires  p ,  units  of  processing-time.  The  jobs  are  numbered  as  they  arrive  such  that  r,  <  r,  if 

i  <  j.  The  total  number  of  jobs  (/?) ,  all  r/s,  and  all  /?,’ s  are  fixed  and  known  at  the  time  of 
scheduling. 

2.  There  is  only  one  machine  available.  All  the  n  jobs  must  be  processed  on  this 

machine.  The  machine  cannot  handle  more  than  one  job  at  a  time  but  remains  available  con¬ 

tinuously  until  every  job  is  completed. 

3.  The  processing  time  of  each  job  is  sequence  independent.  There  is  no  set-up  time  (or 
set-up  time  is  included  in  the  processing  time),  no  due  date,  and  no  priority  attached  to  any 
job. 

4.  No  pre-emption  and/or  inserted  idle  time  is  allowed  in  the  schedule.  That  is,  the  pro¬ 
cessing  of  a  job  once  started  cannot  be  stopped  before  its  completion,  and  also  the  machine 
cannot  be  kept  idle  when  there  is  a  job  waiting  to  be  processed. 
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5.  Define  C,  to  be  the  completion  time  of  job  j ;  c,  ^  p,  +  rr  Also  define  F,  to  be  the 
follow  time  of  job  j ;  F,  —  C,  —  r 

6.  The  solution  of  the  problem  involves  obtaining  a  schedule  that  meets  the  conditions  1 
to  4  and  minimizes  the  mean  flow  time  ( F ): 

F  -  £  FJn  -  £  (c,  -  r,)/n. 
j- i  /-i 


In  model  B  condition  #4  of  model  A  is  relaxed.  In  this  model  a  job  may  be  pre-empted 
any  number  of  times  but  it  is  assumed  that  the  benefit  of  any  processing  that  has  been  done  on 
the  job  is  completely  forfeited  with  every  interruption,  so  that  the  processing  on  a  pre-empted 
job  must  start  from  the  beginning  whenever  it  returns  to  the  machine. 

The  static  n/l/F  problem,  in  which  all  the  jobs  arrive  simultaneously,  has  a  straight  for¬ 
ward  solution.  It  is  known  that  there  is  no  need  to  consider  any  pre-emption  or  inserted  idle 
time  in  the  schedule  (4].  The  mean  flow  time  is  minimized  by  the  Shortest  Processing  Time 
(SPT)  rule  which  sequences  the  jobs  such  that: 

Pill  *  P[2\  <P\n\ 

where  [y'l  denotes  the  job  occupying  the  j"'  position  in  the  sequence. 

The  dynamic  single  machine  model  has  been  extensively  studied  in  the  stochastic  form. 
For  the  dynamic  stochastic  model  without  pre-emptive  and  inserted  idle  time  features,  the  SPT 
dispatching  rule  is  optimal  13,5],  (also  see  (4,  p.  1661).  This  rule  selects  a  new  job  only  after 
the  processing  on  the  job  occupying  the  machine  is  finished.  The  next  job  selected  is  always 
from  the  queue  requiring  the  smallest  processing  time. 

In  the  above  model  if  pre-emption  is  permitted  and  the  jobs  may  be  processed  in  pre¬ 
empt  resume  mode,  the  "Shortest  Remaining  Processing  Time  (SRPT)”  rule  is  optimal  [7], 
According  to  this  rule,  when  a  job  is  to  be  selected  from  among  those  waiting,  the  one  with  the 
lowest  remaining  processing  time  is  chosen.  In  addition,  an  arriving  job  pre-empts  the  job 
being  processed  if  the  processing  time  of  the  new  arrival  is  smaller  than  the  remaining  process¬ 
ing  time  of  the  job  occupying  the  machine.  The  problem  of  minimizing  the  mean  flow  time  in 
dynamic  stochastic  model  with  pre-empt-repeat  feature  has  not  been  solved  satisfactorily  (4). 

Consider  now  extending  the  results  of  stochastic  version  to  the  deterministic  version  of 

the  dynamic  models  when  n,  rh  and  pt{j  -1,2 . n)  are  all  fixed  and  known  at  the  time 

of  scheduling.  When  pre-emption  is  permitted  and  jobs  may  be  processed  in  pre-empt-resume 
mode,  the  SRPT  dispatching  rule  sequence  is  still  optimal  [6].  But  it  is  easy  to  see  that  for 
nonpre-emptive  and  noninserted  time  mode  of  processing  the  SPT  dispatching  rule  does  not 
always  lead  to  an  optimal  sequence.  For  example  consider  the  following  four-job  problem: 


Job  No.  0) 

1 

2 

3 

4 

Ready  time  (r,) 

0 

0 

15 

16 

Processing  time  ( p ) 

12 

15 

6 

1 

The  SPT  dispatching  rule  produces  the  sequence  I -2-4-3  and  the  mean  flow  time  for  this 
sequence  is  17-5.  On  the  other  hand,  the  mean  flow  time  is  equal  to  1 5-25  for  the  sequence  2- 
3-4-1  and  this  is  the  optimal  nonpre-emptive  sequence.  The  optimal  pre-empt-repeat  sequence 
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is  2-4-3- 1  which  gives  the  mean  flow  time  equal  to  14-75.  Thus  it  may  be  concluded  that  the 
SP1  dispatching  may  be  worse  than  the  optimal  nonpre-emptive  schedule  without  inserted  idle 
time  which  in  turn  may  be  worse  than  the  optimal  pre-empt-repeat  schedule,  i.e.  the  schedule 
with  inserted  idle  time  feature.  (In  a  deterministic  pre-empt-repeat  n/l/F  problem  there  is  no 
need  to  consider  any  pre-emption.  The  consequence  of  a  pre-emption  may  be  incorporated  by 
the  provision  of  an  inserted  idle  time  in  the  schedule  14,  p.  96],  and  therefore,  the  permutation 
schedules  constitute  a  dominant  set.  The  choice  of  a  permutation  schedule  uniquely  deter¬ 
mines  the  allocation  of  the  inserted  idle  times  [1,  p.  83).)  However,  it  is  not  known  what 
sequencing  rule  will  provide  an  optimum  sequence  for  either  nonpre-emptive  n/1  IF  model 
(model  A)  or  pre-empt-repeat  n/l/F  model  (model  B). 

It  is  easy  to  see  that  one  could  evaluate  every  permissible  permutation  of  n  jobs  to  find 
the  best  solution  for  either  model  A  or  model  B.  The  real  problem  is  to  find  either  a  direct 
solution  or  an  algorithm  that  reduces'  the  required  number  of  searches  to  a  computationally 
practical  level.  In  this  paper  we  consider  a  general  purpose  technique,  namely,  a  branch  and 
bound  solution  algorithm  that  satisfies  the  later  requirement.  Since  with  only  two  appropriate 
changes  our  algorithm  for  model  A  can  be  adapted  to  model  B,  we  shall  present  a  common 
description  of  the  algorithm  for  both  models.  (The  differences  in  the  algorithm  for  models  A 
and  B  are  noted  in  Properties  1  and  2  given  later.  Properties  I A  and  2A  are  appropriate  when 
dealing  with  model  A  while  those  for  model  B  are  IB  and  2B.) 

In  the  implementation  of  a  general  purpose  technique  it  is  desirable  to  take  advantage  of 
the  structure  of  the  problem,  which  may  reduce  some  computational  work.  We  note  below  one 
such  property  for  each  of  our  two  models: 

PROPERTY  IA:  In  an  n/l/F  deterministic  dynamic  problem  without  pre-emption  and 
inserted  idle  time  features,  the  first  wjobs  may  be  sequenced  independently  of  the  remain¬ 
ing  n-m  jobs  where  m  is  the  first  j  for  which 

/ 

r\  +  L  Pi  5  'v+i;  J  “  i.  2 . w— i 

/-i 

PROPERTY  IB.  In  an  n/l/Fdeterministic  dynamic  problem  with  pre-empt-repeat  feature, 
the  first  m  jobs  may  be  sequenced  independently  of  the  remaining  n-m  jobs  where  m  is  the 
first  j  for  which 

j 

ri  +  £  Pi  <  r,+ ./=  1.2 . n- 1 

cl 

Property  1A  follows  directly  from  the  fact  that  the  first  mjobs  must  be  processed  before 
the  m  +  1st  job  could  start  since  no  pre-emption  and/or  inserted  idle  time  is  allowed  in  the 
schedule.  The  legitimacy  of  Property  IB  is  argued  on  the  ground  that  even  if  the  processing  of 
the  first  m  jobs  were  to  start  at  r„  (and  the  machine  is  kept  idle  during  r,„  -  r,)s  all  the  avail¬ 
able  jobs  at  rm  may  be  processed  according  to  the  the  static  SPT  rule  before  the  m  +  1st  job 
becomes  available  for  processing.  Whenever  possible,  the  Property  1 A  or  IB  (for  model  A  or 
B  respectively)  may  be  utilized  to  partition  the  original  set  of  jobs  into  two  or  more  indepen¬ 
dent  subsets  of  smaller  sizes  and  thereby  reduce  the  computational  work. 

In  section  2  we  develop  our  branch  and  bound  algorithm.  In  section  3  we  present  our 
computational  experience  in  two  parts;  we  first  examine  the  efficiency  of  our  algorithm  for 
both  models,  and  then  compare_lhe  performance  of  the  SPT  dispatching  rule  schedules  with  the 
optimum  nonpre-emptive  n/l/F  schedules  and  the  optimum  pre-empt-repeat  n/l/F  schedules. 
Our  observations  are  summarized  in  Section  4. 
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2.  A  BRANCH  AND  BOUND  SOLUTION  ALGORITHM 

The  general  branch  and  bound  formulation  for  a  single  machine  problem  is  described  by 
Baker  in  [1].  The  solution  algorithm  that  we  present  below  is  similar  to  that  of  Baker  and  Su  in 
[2]  where  they  have  considered  minimizing  the  maximum  tardiness  in  a  pre-empt-repeat  deter¬ 
ministic  dynamic  n/1  model.  Each  node  at  level  k  corresponds  to  a  partial  permutation  contain¬ 
ing  k  jobs.  Associated  with  each  node  is  a  lower  bound  on  the  value  of  the  minimum  mean 
flow.  This  bound  is  computed  by  taking  the  schedule  corresponding  to  the  partial  sequence  and 
completing  the  remaining  jobs  according  to  SRPT  dispatching  rule.  It  follows  from  |6]  that  no 
feasible  solution  of  the  given  partial  sequence  can  attain  a  value  of  Fless  than  this  bound. 

The  calculation  of  lower  bounds  allows  the  algorithm  to  enumerate  many  permutations 
only  implicitly.  If  the  lower  bound  of  some  partial  sequence  is  greater  than  or  equal  to  the 
mean  flow  of  a  known  feasible  sequence,  it  is  not  necessary  to  complete  the  partial  sequence  in 
the  search  for  an  optimum  solution  and,  therefore,  this  node  must  be  eliminated  from  the 
active  list.  Define  a  node  to  be  active  if  the  associated  lower  bound  with  this  node  is  less  than 
the  mean  flow  time  of  the  best  known  feasible  sequence.  Thus  only  active  nodes  are  to  receive 
further  consideration  in  the  search  for  an  optimum  sequence.  Since  a  sequence  resulting  from 
SPT  dispatching  rule  is  feasible  and  has  the  mean  flow  time,  generally  very  close  to  the 
optimum  value,  the  algorithm  starts  with  the  SPT  sequence  as  the  initial  known  feasible 
sequence  and  its  mean  flow  time,  FSPr,  as  the  known  solution. 

The  branch  and  bound  algorithm  maintains  a  list  of  all  active  nodes.  At  each  stage,  the 
node  corresponding  to  the  partial  sequence  with  the  minimum  lower  bound  is  removed  and 
replaced  on  the  list  by  several  nodes  corresponding  to  augmented  partial  sequences.  These  are 
formed  by  appending  one  more  unscheduled  job  to  the  removed  partial  sequence.  The  algo¬ 
rithm  terminates  when  there  is  no  active  node  left  on  the  list. 

In  order  to  reduce  the  computational  requirements,  in  addition  to  the  bounding  tech¬ 
nique,  the  algorithm  uses  two  other  mechanisms.  First,  if  the  SRPT  dispatching  rule  sequences 
the  unscheduled  jobs  of  a  node  without  involving  any  pre-emption,  a  feasible  sequence  is 
obtained.  If  the  node  under  consideration  is  the  first  one,  clearly  an  optimum  sequence  has 
been  reached  (6),  and  the  algorithm  terminates.  Otherwise,  this  solution  either  displaces  the 
currently  known  best  solution  or  is  inferior  to  the  latter.  In  any  case,  there  is  no  further 
branching  from  this  node. 

The  second  mechanism  follows  from  the  requirements  and  structure  of  the  models. 
When  a  partial  sequence  containing  k  jobs  is  removed  from  the  list,  it  would  normally  be 
replaced  by  (n-k)  augmented  sequences,  but  some  of  these  may  be  eliminated  by  taking  advan¬ 
tage  of  Property  2A  and  2B  for  models  A  anb  B  respectively. 

PROPERTY  2A.  In  an  n/l/Fdeterministic  dynamic  problem  without  any  pre-emptive  and 
inserted  idle  time  features,  if  Cm  <  r„  and  there  are  s(s<n-k)  unscheduled  jobs  available 
for  processing  at  Cm  then  the  removed  partial  sequence  from  the  list  can  be  replaced  by  no 
more  than  s  augmented  sequences. 

PROPERTY  2B.  In  an  n/ 1  IF  deterministic  dynamic  problem  with  pre-emptive  repeat 
features  if 

(')  CU]  <  /•„, 

(ii)  among  the  available  unscheduled  jobs  at  Cm,  job  /  has  the  smallest  processing  time 
p,.  and 
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(iii)  there  are  s  unscheduled  jobs  available  before  C|*|  +  p, 

then  the  removed  partial  sequence  from  the  list  can  be  replaced  by  no  more  than  s  augmented 
sequences. 

Properly  2A  (for  model  A)  follows  from  the  requirement  in  model  A  that  there  be  no 
inserted  idle  time  in  the  schedule.  If  there  are  only  s  jobs  available  for  processing  at  Cm 
dearly  one  cannot  have  more  than  s  augmented  sequences  without  incorporating  some  inserted 
idle  time  in  the  schedule.  Property  2B  (for  model  B)  follows  from  the  fact  that  if  the  removed 
partial  sequence  were  to  be  augmented  *ith  a  job  arriving  at  or  after  Cm  +  p,,  processing  of 
job  /  could  certainly  be  completed  in  the  A+lst  position  of  the  sequence  before  the  arrival  of 
the  former. 

The  s  calculated  in  Property  2A  and  2B  is  in  fact  the  upper  bound  upon  the  actual  number 
of  augmented  sequences  resulting  from  the  removed  sequence.  The  actual  number  will  gen¬ 
erally  be  less  than  s  because  of  the  first  mechanism  discussed  earlier. 

Because  the  bound  obtained  with  SRPT  dispatching  is  not  loo  far  from  the  optimal  value, 
and  also  because  the  upper  bound  provided  by  SPT  dispatching  rule  is  close  to  the  optimal 
value,  the  substitution  and  elimination  mechanisms  are  very  effective  in  reducing  the  computa¬ 
tional  efTorts. 

3.  COMPUTATIONAL  EXPERIENCE  AND  RESULTS 

The  branch  and  bound  algorithm  was  implemented  as  a  FORTRAN  program  on 
IBM/370/158  Computer  of  UNB.  The  algorithm  was  tested  for  240  different  problems  for  each 
of  the  two  models  A  and  B.  These  problems  were  specially  designed  to  explore  the  algorithm 
performance  by  varying  the  problem  size  and  the  tightness  of  the  schedule. 

Three  problem  sizes  were  examined:  n  —  10,  20,  and  30.  Integer  values  from  two 
different  uniform  distributors  were  sampled  to  generate  a  job-set  constituting  a  test  problem: 
the  arrival  times  were  sampled  from  a  uniform  distribution  between  0  and  10 •«;  the  processing 
times  were  independent  of  the  arrival  times  and  were  sampled  from  another  uniform  distribu¬ 
tion  between  1  and  20p  where  p  is  the  traffic  density.  Eight  different  values  of  p  were 
included:  p  =  0.6,  0.75.  0.9,  0.1,  1.25,  1.5,  2.0,  and  5.  For  each  n  and  p  combination  10 
different  job-sets  were  randomly  generated  Thus,  in  all  240  different  sets  of  jobs  were  gen¬ 
erated  to  obtain  the  240  lest  problems. 

The  same  240  problems  were  sequenced  under  both  model  A  and  model  B.  Properties 
1A  and  2A  were  incorporated  into  the  algorithm  when  sequencing  the  jobs  under  model  A; 
when  sequencing  under  model  B  properties  IB  and  2B  were  used.  The  algorithm  obtained  an 
optimum  sequence  for  each  of  the  240  problems  under  each  of  the  two  models. 

The  entire  computation  was  completed  in  six  computer  runs;  three  runs  for  each  of  the 
two  models,  and  one  run  for  each  problem  size.  Each  run  involved  sequencing  80  problems 
resulting  from  ten  replications  for  each  of  the  eight  p’s.  The  computational  results  for  both 
models  A  and  B  are  summarized  in  Tables  I,  II,  and  III  for  n  -  10,  20,  and  30  respectively. 

The  average  CPU  time/problem  (including  the  time  required  for  generating  the  problems) 
under  model  A  were  0  078,  1-808  and  76  562  seconds  for  n  =  10,  20,  and  30  respectively.  The 
corresponding  figures  under  model  B  were  0.089,  1.427,  and  92.675.  These  figures  indicate  that 
our  algorithm  is  highly  efficient  for  both  models  A  and  B.  However,  the  trend  clearly  indicates 
that  as  n  increases  the  required  CPU  time  increases  exponentially. 
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We  now  compare  the  performance  of  the  SPT  dispatching  rule  sequence  with  the 
optimum  nonpre-emptive  sequence  and  the  optimum  pre-empt-repeat  sequence.  The  optimum 
total  flow  time  for  10  problems  for  each  of  24  «  and  p  combination  under  SPT  dispatching  rule, 
under  nonpre-emptive  model,  and  under  pre-empt-repeat  model  are  given  in  Tables  I  through 
Ill  in  Columns  1,  2,  and  5  respectively.  The  relative  improvement  in  flow  by  the  optimum 
nonpre-emptive  schedule  over  the  SPT  dispatching  rule  is  shown  in  Column  4.  The  relative 
improvement  by  the  optimal  pre-empt-repeat  schedule  over  the  SPT  dispatching  rule  is  shown 
in  Column  8.  The  entries  in  Columns  4  and  8  clearly  indicate  that  the  improvement  in  the 
mean  flow  time  by  either  the  optimum  nonpre-emptive  schedule  or  the  optimum  pre-empt- 
repeat  schedule  over  the  SPT  dispatching  rule  sequence  is  very  little  if  any. 


TABLE  l.  Total  Flow  and  Computational  Experience 
(Cumulative  results  for  10  problems  for  each  p;  n  =  10) 


S.N, 

SPT 

SEQ. 

Nonpre-emptive 

Optimal  SEQ. 

Pre-emptive-repeat 

Optimal  Sequence 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

Total 

Flow 

Total 

Flow 

No.  of 
nodes 
gener¬ 
ated 

% 

improve¬ 

ment 

(l)-(2) 

(2) 

Total 

flow 

No.  of 
nodes 
gener¬ 
ated 

Total 

in¬ 

serted 

idle 

time 

% 

improve¬ 
ment 
(1)  — (5) 
(5) 

1 

0.6 

1035 

1035 

63 

0 

1028 

5 

0.680 

2 

0.75 

1287 

1287 

92 

0 

1280 

176 

3 

0.546 

3 

0.9 

1896 

1896 

119 

0 

1882 

258 

16 

0.850 

4 

1.0 

1766 

1759 

175 

0.397 

1738 

294 

18 

1.611 

5 

1.25 

3123 

3114 

175 

0.389 

3071 

294 

23 

1.693 

6 

1.5 

3612 

3612 

109 

0 

3590 

199 

4 

0.612 

7 

2.0 

5101 

5090 

146 

0.216 

4968 

307 

33 

2.677 

8 

5.0 

19395 

19395 

51 

0 

18477 

176 

34 

4.968 

Total 

37217 

37188 

930 

0.077 

36034 

1794 

136 

— 

3.289 

Nonpre-emptive 

Pre-emptive  repeal 

Total  CPU  time  for  80  problems 
(in  seconds  on  IBM  370/158) 

6.26 

7.14 

Time/problem 

0.078 

0.089 

No.  of  nodes/problem 

12 

22 

Further,  in  most  practical  stituations  all  p,‘ s  and  r,’s  have  to  be  estimated.  These  esti¬ 
mates  themselves  are  quite  liable  to  be  jmprecise.  In  light  of  the  fact  that  the  differences 
between  Fptc.c ^Nonpre-empiive*  and  FSP1  are  very  small  even  in  the  deterministic  case,  an 
optimal  schedule  (with  or  without  inserted  idle  time  feature)  based  on  imprecise  estimates  can 
hardly  be  expected  to  preform  significantly  better  than  the  SPT  dispatching  rule  sequence  based 
on  the  same  estimates. 

4.  CONCLUSIONS 

We  have  developed  a  branch  and  bound  algorithm  for  minimizing  the  mean  flow  time  of  a 
"dynamic  deterministic  «jobs  one  machine  problem"  when:  (i)  pre-emption  and  inserted  idle 
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TABLE  II.  Total  Flow  and  Computational  Experience 
(Cumulative  results  . for  10  problems  for  each  p;  n  =  20) 


82153 

2915 

4563 

4667 

7310 

11165 

18380 

63663 


Nonpre-emptive 
Optimal  SEQ. 


(2)  (3)  (4) 


No.  of  % 

Total  nodes  improve- 

Flow  gener-  ment 

( 1 ) — (2) 

ated 


2153 

2901 

4559 

4635 

7293 

11137 

18316 

63638 


Pre-emptive-repeat 


Total  114796  1  14632  27181 


2132 

2863 

4436 

4489 

7232 

11023 

18244 

62693 


113112 


741 

1472 

3805 

6538 

4970 

3916 

7534 

1111 


30087 


(7) 

(8) 

Total 

% 

in- 

improve- 

serted 

ment 

(1)  — (5) 

(5) 

time 

8 

0.984 

14 

1.810 

27 

0.608 

41 

3.519 

22 

1.078 

18 

1.288 

14 

.745 

13 

1.547 

157 

1.488 

544 
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TABLE  III.  Torn!  Flow  and  Computational  Experience 
(Cumulative  results  for  10  problems  for  each  p;  n  =  30) 


S.N. 

P 

SPT 

SEQ. 

Nonpre-emptive 

Optimal  SEQ. 

Pre-emptive-repeat 

Optimal  Sequence 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

(8) 

Total 

Flow 

Total 

Flow 

No.  of 
nodes 
gener¬ 
ated 

% 

improve¬ 
ment 
( 1 )  —  (2) 
(2) 

Total 

flow 

No.  of 
nodes 
gener¬ 
ated 

Total 

in¬ 

serted 

% 

improve¬ 
ment 
(1)  — (5) 
(5) 

1 

0.6 

3082 

3079 

236 

WESSM 

3041 

1160 

16 

1.348 

2 

0.75 

4426 

4417 

3585 

■SSI 

4407 

12338 

3 

0.431 

3 

0.9 

6389 

6352 

7216 

Worm 

6249 

12573 

30 

2.240 

4 

1.0 

9670 

9628 

48369 

0.436 

9609 

64635 

12 

0.634 

5 

1.25 

19763 

18680 

178762 

0.337 

18667 

142348 

10 

0.417 

6 

1.5 

25570 

25546 

94138 

0.094 

25458 

52859 

13 

0.439 

7 

2.0 

39894 

39807 

12643 

0.218 

39651 

19864 

3 

0.612 

8 

5.0 

117177 

117143 

13691 

0.029 

115730 

9315 

67 

1.250 

Total 

224951 

224652 

358640 

0.133 

222812 

314102 

154 

0.960 

Nonpre-emptive 

Pre-emptive 

Sequencing 

repeat  Sequencing 

Total  CPU  time  for  80  problems, 
(in  seconds  on  IBM  370/158 

6125.02 

7414.35 

Time/problem 

76.562 

92.675 

No.  of  nodes/problems 

2785 

3938 

time  are  not  allowed,  or  (ii)  pre-emption  is  allowed  but  the  jobs  follow  a  pre-empt-repeat  dis¬ 
cipline.  Our  algorithm  is  quite  efficient  for  moderate  n  (n  <  30). 

Our  results  show  that  the  optimum  nonpre-emptve  or  pre-empt-repeat  n/l/F  schedules 
are  not  significantly  superior  to  Phipp’s  SPT  dispatching  rule  schedules. 
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ABSTRACT 

For  large  numbers  of  perfeclly  reliable,  optimally  targeted  warheads  the 
square-root  law  approximates  the  expected  fraction  damage  achieved  on  an  area 
target.  In  this  paper  a  more  exact  expression  is  derived  lor  this  damage  fraction 
which  holds  for  all  numbers  of  warheads.  This  expression  is  shown  to  con¬ 
verge  to  the  square-root  law  when  a  large  number  of  warheads  are  fired .  The 
more  exact  expression  is  used  in  a  procedure  to  calculate  expected  damage 
when  warheads  are  unreliable,  and  this  procedure  is  shown  to  be  superior  to  a 
modified  square-root  approximation  which  has  been  used  previously. 


INTRODUCTION 

A  key  problem  in  analyzing  the  effects  of  a  salvo  attack  against  an  area  target  is  to  esti¬ 
mate  the  damage  that  will  result.  This  problem  is  important  in  a  military  engagement  such  as  a 
missile  attack  on  a  city  or  an  anti-aircraft  attack  on  an  air-squadron  for  both  the  offense  and 
defense.  The  offense  will  seek  a  strategy  for  attacking  the  area  target  to  maximize  damage;  the 
defense  will  seek  strategies  to  minimize  damage.  Both  purposes  will  be  served  by  developing 
an  exact  expression  for  the  expected  damage  that  will  occur  when  a  salvo  of  optimally-targeted 
but  unreliable  warheads  is  sent  against  an  area  target  whose  relative  value  within  the  entire  tar¬ 
get  area  is  a  known  function  of  position  within  the  target  area.  Approximations  to  the  expected 
damage  expression  will  also  be  developed  and  examined  to  indicate  the  limits  of  applicability. 

An  historical  perspective  of  this  problem  can  be  found  in  Ref.  [5].  The  starting  point  for 
our  purposes  is  the  asymptotic  expected  damage  expression  for  a  perfectly  reliable  salvo  attack 
on  an  area  target.  For  a  large  number  of  reliable  bursts  optimally  targeted  to  an  area  target 
whose  value  function  has  a  symmetric  bivariate  (or  circular)  normal  distribution,  the  damage 
has  been  calculated  using  the  square-root  damage  law: 

£.v  =  1  -  (1  +  Ky/N)  e~Kj*  . 

,V  is  the  number  of  warheads  sent  and  A  is  a  factor  associated  with  the  target  which  combines 
the  effects  of  target  hardness  and  size  and  warhead  and  delivery  system  characteristics.  The 
principal  problem  addressed  in  this  note  is  to  find  an  exact  expression  for  £v  for  an  arbitrary 
(small)  number  of  unreliable  warheads  when  K  is  defined  in  agreement  with  the  square-root 
law  and  the  target  has  symmetric  normally  distributed  value.  This  is  an  alternative  to  inaccu¬ 
rate  approximations  such  as  the  A"  method  presented  in  Ref.  [4]  using  the  square-root  law.  A 
derivation  of  the  square-root  law  is  also  given,  as  existing  derivations  are  inaccessible  or  quite 
abstract  (see  Refs,  ll]  and  [3]).  The  development  below  is  based  on  work  in  Ref.  [5]  and 
corrects  the  extension  of  Ref  [5]  found  in  Ref.  [2]. 
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2.  DEVELOPMENT  OF  AN  EXACT  EXPRESSION  OF  £v 

VValsh  [5]  derives  the  probability  density  function,  P ,  of  weapon  impact  points  to  maxim¬ 
ize  target  damage  for  an  arbitrary  target,  where  the  relative  value  of  points  within  the  target 
area  is  given  by  a  probability  density  function,  i.e.,  the  total  target  value  is  normalized  to  1.  To 
the  degree  that  warheads  can  be  targeted  and  delivered  according  to  the  probability  distribution 
approximated  by  P ,  Walsh’s  expression  for  £v  represents  the  damage  from  optimally  targeted 
(maximum  damage)  reliable  warheads.  In  every  case  his  £v  is  an  upper  bound  to  attainable 
damage.  Wash's  results  expressed  in  polar  coordinates  are: 


(1) 


P(r,9)  = 


T(r,9) 


v-i 


;  T(r,0)  >  X 
;  T(r,9)  ^  X 


(2) 


£v  = 


T(r,9) 


Xv 

T(r,9) 


.v-i 


rdrdO 


where  N  is  the  number  of  warheads  delivered  to  a  target  centered  at  (r,9)  =  (0,0)  with  relative 
value  of  the  point  (r,0)  given  by  the  density  function  T(r,9)  and  where  X  (a  Lagrange  multi¬ 
plier  entering  the  derivation)  is  the  solution  of 


(3) 


X 

V-I 

T(r.O) 

rdrdO 


7 tR2  . 


The  right  hand  side  of  (3),  irR 2,  is  the  area  destroyed  by  a  single  burst. 


For  the  symmetric  Gaussian  valued  target  assumed  for  most  of  the  subsequent  develop¬ 
ment, 

r1 

T(r,  9) - - — r  e  2":. 

2wtr2 

where  a  is  a  scale  factor  for  the  absolute  size  of  the  target.  Hence  the  region  of  integration  in 
(3),  where  T  will  be  greater  that  X,  is  a  circle  of  radius  /•„,  where 

r„  —  yj— 2<T2/nX2ir(T2  . 

Note  that  this  expression,  and  (3),  only  have  meaning  when  X  <  (2 ira2)-1  Equations  (1) 
through  (3)  can  be  simplified  by  performing  the  integration  on  0,  where  T(r )  =  T(r,  9)  is 
independent  of  9.  Using  the  expression  for  T(r)  and  integrating  Equations  (2)  and  (3),  the 
following  are  obtained: 
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1  -  exp  {- 


N  -  1 


1  —  2irk<r2N  1 - — —  ( 2nktr 2)  N  1  i  N  ^  1 

Hr 


for  iV  =  1: 


Jthe  solution  to  the  following  equation  for  N  s^l: 


(2nka2)  v  1  expj-(2wX<r2)  *  1  I  -exp  -  1  + - - - 

1  •  '  2<t2(N—\) 


Equation  (5)  may  be  solved  for  X  fairly  easily  using  Newton-Raphson  iteration.  Let 
Q  -  (2tta<t;!)  '  ,  then  (5)  becomes 


Qe~v  -  exp{  -  1  + 


Equation  (6)  may  be  solved  iteratively  by  a  recursion  which  converges  quickly  for  all 
R,  (t,  and  N:  take 

°" ' e>T 1  +  ))and l"r,,ive re"mion  a*’  -  cpr)  |ua  +  1 


With  R/ct  identified  as  K  in  the  square-root  damage  law,  an  algorithm  to  calculate  £v 
exactly  may  be  summarized  as  follows: 


For  N  -  1;  £,  -  1  -  e  2 


for  N  ^  1;  £\  —  1  —  NQV  1  ■+■  (N— 1)Q\  where  Q  is  found  by  the  iterative  recursion 


2(^-1) 


£>n  -  exp  -1  - 


0,-1  I  2 ( /V — 1 ) 


+  lnQ,\,  (/  >  0)  . 


The  above  algorithm  will  calculate  Q  to  within  0.0001  in  at  most  14  iterations.  Conver¬ 
gence  can  be  speeded  considerably  if  an  alternative  Q„  is  used  for  small  values  of  K2/(N-l) 

u-  - 1  -  Sr 


3.  DERIVATION  OF  SQUARE-ROOT  DAMAGE  LAW  FOR  RELIABLE  WARHEADS 


The  square-root  damage  law  can  be  derived  from  the  exact  theory  as  an  asymtotic  approx¬ 
imation.  As  such  it  can  be  expected  to  approximate  the  exact  expression  for  large  values  of  A'. 
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Taking  logarithms  of  (5)  and  setting  R/cr  =  K ,  we  obtain 

Q  -  i«Q  -  i  +  • 


F  or  ,V  >  >  1,  0  is  near  1,  and  the  logarithm  can  be  approximated  by  the  first  two  terms  of  its 
Taylor  expansion  InQ  ~  (0  —  1)  -  ^  ^  +  ...  In  this  form  the  following  approximations 
are  obtained: 


and  £v  =  1  -  0  v~'(l  +  AsAVM)  . 


in  taking  the  limit  as  N  gets  large,  some  normalization  is  needed,  otherwise  £\  will  converge  to 
1.  Assume  that  the  total  destructive  power  of  the  attack  remains  constant  but  that  it  can  be 
generated  in  any  number  of  equally  sized  weapons,  i.e.,  this  means  that  ( NttR2)/(tt<t 2) 
remains  constant  as  N  increases  or  equivalently  that  K\fN  =  (R/<t)VN  will  remain  constant  as 
jV  increases.  With  this  normalizing  assumption,  recalling  that 


e*  =  lim  (1  +  -)"  . 

H—oo  n 

and  rewriting  0N  1  as 

iV-1 

one  obtains  the  result  that  0S_I  =  exp{-AVA )  for  large  N.  Hence, 

£v  =  1  -  (1  +  KVN)e~K'J*  for  large  N  . 


>  v  - 1 


1  A 

r*  —  i 

The  exact  damage  law  can  easily  be  compared  with  the  square-root  law  for  different  K  and 
N.  The  square-root  law  always  underestimates  the  damage.  The  two  calculations  tend  to  agree 
asymptotically  for  large  A’,  and  they  are  no  more  than  3%  apart  for  N  >  7,  and  0.6  <  K  <  4. 

The  square-root  law  could  be  modified  slightly  to  produce  much  better  empirical  agree¬ 
ment  with  the  more  exact  calculator  This  modified  square-root  law  is: 

(7)  £,  =  1  —  e~~ 

£.v  -  1  -  (1  +  KyfN+\)e (A>1)  . 

The  difference  between  this  and  the  exact  law  is  less  than  4%,  and  less  than  3%  for  N  >  3.  In 
fact  for  K  =  1.14,  the  modified  square-root  law  at  /V  =  2(3)  is  2%  (1%)  too  low  and  less  than 
1%  too  low  for  all  other  values  of  (V. 


4.  EXPECTED  DAMAGE  WHEN  WARHEADS  ARE  UNRELIABLE 

The  expressions  for  £v  as  given  by  any  of  the  previous  formulas  give  the  expected  dam¬ 
age  given  that  exactly  N  optimally  targeted  warheads  are  sent  and  detonated.  In  the  general 
case  there  is  a  probability,  Py,  that  exactly  N  warheads  out  of  the  total  of  M  sent  do  indeed 
succeed,  where  the  Ps  may  be  calculated  from  a  simulation  of  an  entire  engagement  or  other 
method.  The  total  expected  damage,  £,  is  given  properly  by 
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w 

£=  I  ESPN 

i 

under  the  assumption  that  the  A  successful  warheads  are  laid  down  approximately  optimally 
given  that  there  are  A  successes.  Note  that  this  is  not  the  same  as  the  damage  expected  from 
£  A/*v  reliable  warheads  unless  £v  is  linear  in  A.  As  an  approximation,  one  may  assume  that 
each  of  the  warheads  has  a  probability  of  success  Pt  .  In  this  case,  P\  is  binomial,  and 


si 


I  EN[N\(PLy 

v-i 


(1  -PL)U~ 


4  The  last  equation  may  be  compared  with  the  method  of  [4]  which  uses  a  modified  A  value 

s'  denoted  A'  in  the  square  root-law  to  obtain  E.  In  [4]  A  "is  the  solution  of 

D  =  P,  [  1  —  (1  +  K)c  A]  =  1  -  (1  +  K  )e  K  . 

which  may  be  obtained  from  the  iteration  formula: 

A'+t  =  A"  +  1(1  +  A’,)  +  eK  (£>-1)1  A'„  with  An  =  1  . 

This  method  (4|  then  estimates  the  total  expected  damage  by 


(8)  E  =  1  -  (1  +  A>/A )e~Ky^  . 

The  method  uses  an  approximation  to  the  proper  expected  value  and  an  approximation  to  the 
exact  damage.  Thus  (8)  cannot  be  expected  to  be  accurate  for  all  values  of  A  and  A. 

The  four  different  approaches  discussed  above  are  illustrated  in  Figure  1  for  three  values 
of  A.  These  show  that  E  computed  correctly  using  the  exact  theory  for  £\  is  greater  than  E 
computed  using  the  square-root  law  and  taking  the  expected  value  properly.  Both  of  these  are 
greater  than  £  using  the  A' approach.  The  empirical  correction  to  the  square-root  law  given  in 
(7)  is  also  displayed  assuming  the  expected  value  for  unreliable  warheads  is  taken  correctly. 

0 

It  is  clear  from  these  results  that  the  exact  theory  for  £v  using  (4)  and  (5)  and  the  correct 
expected  value  expression  for  £  is  preferred,  although  the  A'+l  square  root  expression  (7)  and 
a  proper  expectation  is  a  possibly  acceptable  alternative.  Both  of  these  are  superior  to  the  A' 
method  (8)  and  the  usual  square-root  law  with  proper  expected  value  calculation. 
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The  following  listing  was  omitted  from  the  Cumulative  Twenty  Five  Year  Index  which  appeared 
in  the  December  1978  issue: 

Love,  R.  F.,  "A  Two-Station  Stochastic  Inventory  Model  with  Exact  Method  of  Com¬ 
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